-- Logs begin at Wed 2022-06-15 18:52:06 UTC, end at Wed 2022-06-15 19:59:23 UTC. -- Jun 15 19:29:09.650286 dv-cinder-844563-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 19:29:09.657472 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 19:29:09 2022] *** Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: nodename: dv-cinder-844563-3-iscsi Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: machine: x86_64 Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: clock source: unix Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: pcre jit disabled Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: detected number of CPU cores: 4 Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: current working directory: / Jun 15 19:29:09.661106 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: detected binary path: /usr/bin/uwsgi-core Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: your processes number limit is 47680 Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: your memory page size is 4096 bytes Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: detected max file descriptor number: 2048 Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: lock engine: pthread robust mutexes Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: thunder lock: enabled Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 19:29:09.661843 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 19:29:09.705776 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: Python main interpreter initialized at 0x55d795f3f9c0 Jun 15 19:29:09.705776 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: python threads support enabled Jun 15 19:29:09.705776 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: your server socket listen backlog is limited to 100 connections Jun 15 19:29:09.705776 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: your mercy for graceful operations on workers is 90 seconds Jun 15 19:29:09.706185 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 19:29:09.706264 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: *** Operational MODE: preforking *** Jun 15 19:29:09.706457 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: *** uWSGI is running in multiple interpreter mode *** Jun 15 19:29:09.706457 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: spawned uWSGI master process (pid: 103330) Jun 15 19:29:09.706644 dv-cinder-844563-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 19:29:09.707765 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: spawned uWSGI worker 1 (pid: 103331, cores: 1) Jun 15 19:29:09.709201 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: spawned uWSGI worker 2 (pid: 103332, cores: 1) Jun 15 19:29:09.709201 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 19:29:10.359773 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 19:29:10.361269 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 19:29:11.534820 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:29:11.534820 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: from cryptography.utils import int_from_bytes Jun 15 19:29:11.535451 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:29:11.535451 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: from cryptography.utils import int_from_bytes Jun 15 19:29:11.535813 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:29:11.535813 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: from cryptography.utils import int_from_bytes Jun 15 19:29:11.536260 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:29:11.536260 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: from cryptography.utils import int_from_bytes Jun 15 19:29:14.068060 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 19:29:14.068719 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 19:29:14.068719 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 19:29:14.069151 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 19:29:14.069252 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 19:29:14.069341 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 19:29:14.069421 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 19:29:14.069513 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 19:29:14.069513 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 19:29:14.069664 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 19:29:14.069745 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.069829 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.070057 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.070196 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.070398 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.070505 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.070711 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.070814 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071032 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071127 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071335 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071437 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071644 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071731 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.071954 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072050 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072272 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072359 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072525 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072619 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072833 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.072930 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.073148 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-3-iscsi {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.073234 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-3-iscsi {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.073459 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.073554 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.073756 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.073855 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.074057 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.074193 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.074394 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.074481 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.074689 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.074783 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.075002 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.075088 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.075298 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.075382 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.075784 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076229 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076229 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076466 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076589 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076704 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076809 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.076913 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.077090 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.077210 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.077925 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078029 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078254 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078386 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078570 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078656 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078872 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.078967 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.079189 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.079274 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.079490 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.079579 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.079875 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-3-iscsi {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.079962 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-3-iscsi {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.080181 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.080275 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.080484 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.080576 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.080789 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.080883 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.081189 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.081289 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.081493 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.081585 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.081797 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.081883 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.082122 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.082212 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.082442 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.082523 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.082741 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.082839 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083058 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083197 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083368 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083454 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083680 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083766 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.083990 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084077 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084284 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084378 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084584 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084885 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.084980 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.085193 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.085305 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.085488 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.085577 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.085785 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.085871 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086027 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086140 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086352 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086448 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086665 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086759 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.086973 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087067 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087286 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087382 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087530 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087627 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087773 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.087871 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088084 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088177 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088500 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088694 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088781 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.088991 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089083 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089289 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089387 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089604 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089690 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089884 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.089969 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.090203 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.090376 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.090504 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.090590 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.090801 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.090887 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.091110 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.091207 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.091413 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.091498 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.091728 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.091815 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.092028 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.092114 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.092336 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.092429 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.092721 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.092808 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.093503 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.093609 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.093810 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.093897 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.094158 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.094246 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.094474 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.094572 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.094772 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.094858 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095080 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095173 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095392 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095477 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095690 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095776 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.095989 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.096086 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.096285 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.096421 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.096593 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.096687 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.096916 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097019 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097214 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097300 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097457 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097543 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097749 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.097848 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098044 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098238 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098377 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098473 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098677 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098770 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.098974 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099059 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099272 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099364 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099564 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099650 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099862 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.099948 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.100158 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.100243 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.100475 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.100606 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.100756 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.100842 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101053 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101138 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101345 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101431 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101643 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101728 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.101937 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102022 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102258 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102346 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102567 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102663 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102878 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.102982 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.103178 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.103264 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.103474 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.103568 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.103773 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.103869 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104165 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104378 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104464 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104674 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104766 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.104972 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105059 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105285 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105372 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105580 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105666 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105877 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.105964 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.106205 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.106338 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.106506 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.106610 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.106803 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.106900 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.107111 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.107196 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.107402 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.107496 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.107698 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.107792 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108007 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108093 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108305 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108403 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108629 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108723 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.108933 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109020 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109229 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109323 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109525 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109610 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109818 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.109903 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.110129 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.110229 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.110431 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.110524 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.110722 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.110810 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111031 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111125 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111343 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111430 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111642 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111727 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.111940 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.112026 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.112235 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.112320 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.112544 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.112643 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:29:14.112869 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.112955 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.113191 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.113277 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.113524 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.113618 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.113831 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.113925 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.114176 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.114278 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.114503 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.114598 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.114814 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.114899 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.115117 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.115202 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.115423 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.115519 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.115740 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.115826 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116044 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116129 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116346 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116440 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116647 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116732 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.116956 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117048 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117265 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117373 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117585 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117672 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117894 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.117988 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.118227 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.118328 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.118541 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.118630 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.118844 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.118930 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.119154 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.119241 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.119471 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.119563 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.119784 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.119877 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.120086 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.120173 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.120421 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.120508 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.120754 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.120848 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121060 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121146 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121374 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121461 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121687 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121785 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.121991 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.122072 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.122322 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.122425 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.122625 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.122726 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.122941 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123035 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123263 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123349 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123569 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123663 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123880 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.123972 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.124212 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.124522 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.124865 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.125178 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.125484 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.125815 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.125902 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.126146 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.126236 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.126460 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.126555 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.126768 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.126862 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.127081 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.127224 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.127387 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.127474 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.127958 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128048 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128264 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128376 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128563 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128651 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128862 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.128950 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.129162 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.129275 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.129467 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.129602 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.129762 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.129862 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.130074 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.130256 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.130406 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.130492 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.130704 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.130789 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131009 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131106 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131311 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131399 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131613 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131706 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.131917 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132048 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132219 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132308 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132517 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132603 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132822 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.132918 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.133128 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.133221 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.133424 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.133510 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.133728 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.133815 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134030 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134137 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134351 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134451 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134661 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134747 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.134957 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135042 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135258 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135353 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135566 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135660 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135868 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.135966 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.136172 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.136266 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.136476 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.136599 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.136778 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.136873 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.137088 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.137189 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.137396 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.137483 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.137701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.137798 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138008 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138115 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138343 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138433 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138655 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138742 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.138966 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.139096 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.139275 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.139363 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.139584 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.139678 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.140402 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.140491 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.140707 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.140795 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141006 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141104 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141305 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141395 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141603 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141690 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.141908 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142011 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142227 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142318 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142527 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142632 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142825 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.142926 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.143122 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.143209 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.143419 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.143506 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.143720 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.143854 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144023 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144110 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144320 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144405 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144618 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144718 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.144933 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145021 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145230 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145316 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145537 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145638 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145837 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.145923 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.146159 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.146262 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.146463 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.146552 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.146806 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.146893 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.147111 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.147198 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.147419 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.147506 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.147727 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.147816 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148035 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148124 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148344 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148440 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148650 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148775 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.148966 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149063 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149273 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149358 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149584 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149679 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149889 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.149986 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.150220 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.150309 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.150539 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.150634 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.150845 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.150941 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.151142 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.151236 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.151452 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.151539 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.151768 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.151874 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.152075 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.152163 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.152392 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.152479 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.152692 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.152788 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153001 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153094 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153311 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153406 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153618 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153715 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.153926 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154012 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154253 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154343 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154562 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154650 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154877 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.154970 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.155184 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.155270 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.155548 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.155640 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.155855 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.155943 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.156164 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.156250 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.156466 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.156553 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.156777 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.156863 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.157074 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.157175 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.157384 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.157472 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.157700 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.157795 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158007 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158122 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158346 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158433 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158645 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158732 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.158957 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159053 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159260 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159353 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159565 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159651 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159870 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.159966 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.160169 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.160257 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.160475 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.160562 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.160781 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.160875 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161084 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161212 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161385 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161472 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161771 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.161979 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.162175 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.162307 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.162402 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.162608 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.162696 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.162919 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163008 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163203 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163289 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163500 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163587 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163811 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.163897 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.164113 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.164200 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.164413 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.164513 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.164711 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.164800 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165009 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165115 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165307 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165394 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165617 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165702 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.165918 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166017 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166236 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166337 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166535 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166623 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166832 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.166929 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.167153 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.167248 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.167458 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.167546 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.167753 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.167856 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168050 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168137 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168347 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168441 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168656 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168750 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.168964 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169051 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169266 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169351 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169566 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169655 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169884 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.169972 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.170213 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.170304 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.170523 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.170610 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.170828 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.170914 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.171646 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.171735 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.171954 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172050 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172259 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172346 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172562 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172664 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172868 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.172954 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.173172 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.173265 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.173474 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.173569 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.173772 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.173860 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.174075 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.174180 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.174403 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.174499 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.174709 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.174968 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.175056 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.175297 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.175391 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.175602 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.175688 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.175912 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.176005 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.176227 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.176467 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.176563 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.176796 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.176883 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.177110 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.177201 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.177425 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.177513 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.177739 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.177836 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178055 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178183 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178378 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178479 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178681 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178768 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.178988 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179122 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179289 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179392 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179590 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179679 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179888 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.179975 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.180186 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.180280 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.180481 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.180575 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.180780 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.180873 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181076 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181162 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181371 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181461 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181676 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181762 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.181972 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.182058 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.182313 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.182403 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.182609 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.182695 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.182905 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183001 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183214 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183301 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183509 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183596 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183806 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.183901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.184100 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.184186 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.184415 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.184502 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.184718 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.184814 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185103 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185313 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185401 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185614 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185717 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.185953 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.186040 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.186280 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.186370 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.186635 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.186728 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.186945 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187033 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187246 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187370 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187545 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187641 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187849 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.187944 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.188152 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.188240 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.188449 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.188537 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.188750 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.188847 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189050 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189138 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189353 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189439 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189653 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189784 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.189948 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190044 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190275 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190377 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190572 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190660 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190881 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.190986 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.191181 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.191269 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.191475 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.191562 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.191768 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.191862 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192064 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192150 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192363 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192459 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192659 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192756 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.192955 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193041 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193247 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193332 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193549 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193644 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193844 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.193930 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.194161 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.194250 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.194458 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.194546 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.194752 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.194839 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195053 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195139 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195348 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195434 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195645 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195739 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.195941 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196029 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196240 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196333 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196540 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196627 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196834 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.196927 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.197131 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.197264 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.197429 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.197516 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.197725 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.197820 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198023 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198125 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198358 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198444 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198656 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198757 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.198955 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199049 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199344 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199548 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199649 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199846 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.199933 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.200144 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.200230 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.200437 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.200530 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.200733 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.200826 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201032 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201117 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201328 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201425 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201625 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201719 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.201917 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.202010 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.202773 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.202874 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203075 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203161 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203374 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203461 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203669 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203763 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.203985 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204071 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204290 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204386 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204590 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204677 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204889 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.204984 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.205189 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.205285 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.205530 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.205616 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.205830 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.205916 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.206155 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.206257 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.206467 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.206555 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.206767 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.206861 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207079 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207175 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207387 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207474 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207693 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207782 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.207991 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208078 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208290 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208376 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208604 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208698 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208909 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.208996 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.209215 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.209319 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.209519 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.209609 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.209819 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.209915 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.210159 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.210261 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.210459 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.210547 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.210764 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.210853 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211157 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211380 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211468 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211686 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211774 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.211984 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212287 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212381 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212592 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212894 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.212981 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.213198 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.213292 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.213502 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.213588 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.213804 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.213891 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.214127 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.214229 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.214436 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.214526 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.214738 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.214825 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215043 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215143 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215345 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215434 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215641 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215727 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.215945 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216032 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216242 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216328 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216547 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216634 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216845 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.216933 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.217142 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.217263 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.217445 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.217573 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.217745 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.218469 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.218633 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.218755 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.218937 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.219063 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.219361 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.219448 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.219669 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.219755 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.219975 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220274 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220362 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220581 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220668 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220891 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.220986 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.221203 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.221290 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.221520 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.221607 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.221823 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.221919 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.222169 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.222259 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.222477 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.222564 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.222794 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.222959 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.223093 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.223181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.223393 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.223480 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.223690 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.223777 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224005 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224093 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224305 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224391 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224607 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224693 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.224907 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225000 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225206 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225293 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225524 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225613 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225824 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.225983 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.226164 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.226311 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.226576 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.226666 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.226887 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.226981 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.227189 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.227284 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.227525 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.227612 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.227823 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.227910 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.228131 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.228227 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.228435 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.228530 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.228752 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.228849 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229166 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229376 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229472 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229684 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229771 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.229979 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.230077 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.230317 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.230416 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.230632 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.230719 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.230937 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231031 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231245 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231341 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231551 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231639 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231869 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.231957 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.232188 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.232332 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.232499 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.232587 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.232815 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.232903 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.233132 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.233227 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.233430 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.233568 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.233757 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.233883 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234056 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234226 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234378 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234537 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234692 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234839 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.234990 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.235140 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.235296 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.235450 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.235602 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.235752 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.235903 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236053 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236201 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236373 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236496 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236673 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236810 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.236982 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.237107 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.237290 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.237422 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.237597 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.237730 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.237898 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238045 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238224 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238383 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238542 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238680 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238844 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.238994 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.239162 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.239298 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.239470 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.239594 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.239790 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.239886 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.240108 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.240205 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.240410 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.240499 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.240728 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.240816 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241033 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241129 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241338 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241425 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241636 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241730 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.241937 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.242026 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.242301 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.242447 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.242606 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.242695 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.242922 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243011 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243237 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243324 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243557 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243645 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243859 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.243985 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.244159 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.244273 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.244464 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.244578 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.244764 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.244884 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245062 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245176 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245359 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245482 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245665 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245778 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.245962 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246075 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246283 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246408 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246581 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246695 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246879 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.246992 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.247179 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.247303 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.247485 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.247600 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.247783 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.247875 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248079 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248175 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248376 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248463 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248672 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248760 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.248973 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.249070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.249320 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.249408 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.249625 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.249712 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.249925 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250014 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250249 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250340 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250551 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250639 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250872 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.250959 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.251176 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.251262 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.251493 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.251578 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.251805 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.251901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.252115 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.252202 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.252426 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.252522 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.252981 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253068 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253289 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253381 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253597 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253693 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253901 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.253989 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.254233 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.254325 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.254544 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.254644 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.254852 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.254939 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.255163 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.255362 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.255473 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.255687 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.255776 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.255998 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.256085 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.256306 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.256393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.256615 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.256711 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.256924 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.257170 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.257257 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.257499 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.257601 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.257816 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.257948 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.258136 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.258227 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.258444 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.258534 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.258756 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.258843 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.259069 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.259159 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.259382 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.259471 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.259692 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.259781 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260002 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260102 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260309 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260403 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260617 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260706 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.260927 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261029 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261245 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261332 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261577 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261663 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261878 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.261977 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.262214 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.262306 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.262523 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.262667 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.262832 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.262921 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.263137 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.263232 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.263443 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.263543 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.263751 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.263846 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.264057 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.264145 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.264362 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.264459 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.264666 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.265276 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.265504 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.265591 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.265812 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.265907 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.266144 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.266233 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.266460 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.266558 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.266768 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.266857 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.267073 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.267159 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.267380 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.267474 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.267689 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.267776 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268006 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268198 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268332 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268508 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268836 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.268946 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.269156 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.269243 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.269473 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.269562 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.269784 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.270050 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.270167 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.270386 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.270535 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.270712 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.270800 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271011 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271099 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271315 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271416 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271621 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271709 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.271926 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272021 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272244 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272345 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272544 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272630 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272840 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.272926 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.273143 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.273237 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.273444 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.273530 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.273741 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.273970 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.274077 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.274339 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.274438 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.274652 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.274740 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.274963 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.275058 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.275269 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.275364 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.275580 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.275789 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.275877 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.276129 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.276217 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.276438 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.276526 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.276757 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.276862 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277067 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277162 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277371 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277459 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277669 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277769 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.277968 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278055 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278296 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278431 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278595 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278694 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278892 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.278979 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.279196 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.279289 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.279493 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.279588 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.279791 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.279886 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.280097 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.280185 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.280440 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.280532 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.280739 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.280827 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281047 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281142 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281344 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281433 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281640 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281726 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.281944 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282031 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282265 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282394 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282563 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282650 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282869 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.282957 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.283168 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.283265 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.283464 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.283551 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.283761 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.283858 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284059 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284145 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284362 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284448 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284659 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284755 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.284963 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285051 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285262 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285350 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285568 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285664 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285867 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.285954 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.286196 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.286287 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.286517 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.286618 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.286824 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.286912 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.287130 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.287224 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.287454 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.287542 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.287766 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.287854 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.288072 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.288287 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.288383 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.288614 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.288709 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.288928 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.289015 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.289257 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.289353 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.289582 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.289670 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.289883 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.290123 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.290212 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.290457 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.290547 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.290772 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.290861 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.291093 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.291257 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.291401 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.291489 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.291705 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.291792 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292008 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292107 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292304 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292391 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292605 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292700 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.292909 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293006 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293211 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293344 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293512 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293599 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293815 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.293902 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.294134 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.294236 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.294441 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.294529 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.294746 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.294835 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295048 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295135 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295352 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295440 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295656 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295745 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.295979 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296070 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296288 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296376 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296593 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296682 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296894 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.296981 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.297197 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.297296 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.297501 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.297589 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.297804 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.297892 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.298133 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.298237 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.298450 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.298537 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.298755 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.298845 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299055 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299152 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299356 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299445 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299660 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299748 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.299970 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300072 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300295 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300395 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300603 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300691 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300906 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.300995 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.301246 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.301333 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.301552 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.301640 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.301874 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.301969 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.302202 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.302295 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.302525 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.302625 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.302841 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.302927 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.303157 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.303245 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.303465 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.303561 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.303763 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.303857 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304062 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304157 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304361 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304461 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304664 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304751 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.304973 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305068 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305277 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305366 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305576 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305664 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305873 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.305960 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.306194 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.306284 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.306494 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.306581 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.306795 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.306884 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307092 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307180 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307390 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307485 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307688 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307776 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.307980 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308068 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308276 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308363 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308572 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308672 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308866 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.308955 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.309161 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.309248 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.309456 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.309551 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.309749 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.309837 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310042 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310158 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310361 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310459 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310658 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310755 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.310952 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.311046 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.311245 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.311340 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.311547 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.312158 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.312371 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.312460 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.312671 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.312760 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.312968 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313065 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313265 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313356 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313565 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313661 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313890 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.313979 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.314232 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.314323 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.314543 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.314632 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.314849 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.314936 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.315152 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.315239 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.315467 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.315556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.315767 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.315855 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316072 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316168 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316377 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316465 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316680 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316775 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.316981 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.317081 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.317283 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.317370 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.317596 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.317684 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.317904 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318000 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318273 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318369 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318537 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318624 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318842 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.318938 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.319146 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.319236 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.319452 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.319538 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.319758 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.319849 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320066 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320153 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320369 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320456 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320673 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320768 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.320982 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321070 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321286 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321386 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321589 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321676 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321896 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.321984 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.322229 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.322335 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.322540 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.322629 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.322852 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.322939 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.323152 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.323289 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.323456 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.323550 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.323766 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.323866 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.324076 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.324175 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.324394 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.324482 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.324713 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.324799 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325017 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325106 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325331 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325417 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325638 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325725 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.325940 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.326027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.326208 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 19:29:14.326354 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.326628 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.326954 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.327313 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.327626 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.327929 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:29:14.328168 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 19:29:14.387560 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO dbcounter [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Registered counter for database nova_api Jun 15 19:29:14.389004 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Registered counter for database nova_api Jun 15 19:29:14.407648 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_db.sqlalchemy.engines [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.409335 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.414386 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writer thread running {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.415710 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.471534 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.context [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4(cell1) {{(pid=103332) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 19:29:14.472524 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.context [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4(cell1) {{(pid=103331) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 19:29:14.475625 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_concurrency.lockutils [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:29:14.476564 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:29:14.477192 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_concurrency.lockutils [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:29:14.478001 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_concurrency.lockutils [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:29:14.478165 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:29:14.478970 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:29:14.479967 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_concurrency.lockutils [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:29:14.480905 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:29:14.481896 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO dbcounter [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Registered counter for database nova_cell0 Jun 15 19:29:14.482859 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Registered counter for database nova_cell0 Jun 15 19:29:14.485737 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO dbcounter [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Registered counter for database nova_cell1 Jun 15 19:29:14.486975 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Registered counter for database nova_cell1 Jun 15 19:29:14.492856 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_db.sqlalchemy.engines [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.494565 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.497949 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writer thread running {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.498443 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.501101 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.633086 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_db.sqlalchemy.engines [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.638337 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writer thread running {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.642747 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.647073 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO dbcounter [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Registered counter for database nova_cell0 Jun 15 19:29:14.651593 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO dbcounter [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Registered counter for database nova_cell0 Jun 15 19:29:14.654140 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG oslo_db.sqlalchemy.engines [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.658555 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writer thread running {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.660098 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_db.sqlalchemy.engines [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:29:14.664344 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writer thread running {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:29:14.992801 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:29:14.993276 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: WARNING keystonemiddleware.auth_token [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:29:15.000187 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:29:15.000576 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: WARNING keystonemiddleware.auth_token [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:29:15.339591 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:29:15.345503 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: WARNING keystonemiddleware.auth_token [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:29:15.345988 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: WARNING keystonemiddleware.auth_token [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:29:15.351232 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d795f3f9c0 pid: 103331 (default app) Jun 15 19:29:15.351520 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: WARNING keystonemiddleware.auth_token [None req-c05e0e42-6f02-4906-83b0-5a116c7d9045 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:29:15.353275 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:29:15.354485 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 Jun 15 19:29:15.354892 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Wed Jun 15 19:29:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:29:15.357074 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d795f3f9c0 pid: 103332 (default app) Jun 15 19:30:31.949040 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:31.950160 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 15 19:30:31.950578 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:30:31.962552 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writing DB stats nova_api:SELECT=3 {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:31.963932 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writing DB stats nova_cell1:SELECT=3 {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:31.964982 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writing DB stats nova_cell0:SELECT=3 {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:31.965743 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:32.402330 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-565a158a-c99e-47f2-83b8-158697d50b77 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:32.433640 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-565a158a-c99e-47f2-83b8-158697d50b77 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476366 Jun 15 19:30:32.434399 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1291 bytes} [Wed Jun 15 19:30:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:34.624373 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:34.625762 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d0b29a95-2d03-4990-bdc6-69c786213cca None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jun 15 19:30:34.630479 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:34.698598 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-a7a83a68-74c2-4734-9a37-057964e15e6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "swap": 0, "name": "cirros256"}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:34.717570 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:30:34.717570 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: warnings.warn(msg) Jun 15 19:30:34.747535 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-a7a83a68-74c2-4734-9a37-057964e15e6c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114775 Jun 15 19:30:34.748377 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:30:34.761691 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:34.762537 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:34.763487 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell1:SELECT=3 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:34.764219 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:30:34.967451 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-dcb9c579-ce65-4eb0-9b66-b0008757cf55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:34.970007 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:30:34.970007 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: warnings.warn(msg) Jun 15 19:30:35.035465 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-dcb9c579-ce65-4eb0-9b66-b0008757cf55 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278823 Jun 15 19:30:35.036057 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1335 bytes} [Wed Jun 15 19:30:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:37.224553 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-a7a83a68-74c2-4734-9a37-057964e15e6c admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:37.225583 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-a7a83a68-74c2-4734-9a37-057964e15e6c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002351 Jun 15 19:30:37.226227 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:37.339140 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-07e0293f-b3cc-4642-80d4-0f8bad795e4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "id": "d1"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:37.358466 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:30:37.358466 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: warnings.warn(msg) Jun 15 19:30:37.379971 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-07e0293f-b3cc-4642-80d4-0f8bad795e4a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147844 Jun 15 19:30:37.381136 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:30:37.395676 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-e6fd743b-a41e-4ec1-babe-4d03d7247cac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:37.397169 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:30:37.397169 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: warnings.warn(msg) Jun 15 19:30:37.449002 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-e6fd743b-a41e-4ec1-babe-4d03d7247cac admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058012 Jun 15 19:30:37.449586 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1335 bytes} [Wed Jun 15 19:30:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:39.723967 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-07e0293f-b3cc-4642-80d4-0f8bad795e4a admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:39.725671 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-07e0293f-b3cc-4642-80d4-0f8bad795e4a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Jun 15 19:30:39.732178 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:39.811703 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-d71d214e-709b-4dc1-9d4a-3b6f7507ad4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "name": "ds1G", "disk": 10}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:39.835241 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-d71d214e-709b-4dc1-9d4a-3b6f7507ad4e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101859 Jun 15 19:30:39.844077 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:30:39.848710 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-9418dffa-6c07-4aff-9ccb-1191fde043d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:39.895278 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-9418dffa-6c07-4aff-9ccb-1191fde043d3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050557 Jun 15 19:30:39.896219 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1335 bytes} [Wed Jun 15 19:30:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:42.108944 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-d71d214e-709b-4dc1-9d4a-3b6f7507ad4e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:42.110689 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-d71d214e-709b-4dc1-9d4a-3b6f7507ad4e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Jun 15 19:30:42.121369 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:42.174764 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ff406e39-b462-48f3-a61c-4e4e55001c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:42.195965 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ff406e39-b462-48f3-a61c-4e4e55001c5d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078583 Jun 15 19:30:42.196515 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:30:42.208537 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-4b31ef48-3b5a-4cc8-bb9e-68d86b78f42f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:42.237910 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-4b31ef48-3b5a-4cc8-bb9e-68d86b78f42f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033142 Jun 15 19:30:42.239629 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1335 bytes} [Wed Jun 15 19:30:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:30:44.461326 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-ff406e39-b462-48f3-a61c-4e4e55001c5d admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:44.462383 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-ff406e39-b462-48f3-a61c-4e4e55001c5d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 15 19:30:44.462787 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:44.552219 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-37d8d390-5fda-49f9-8f26-51f3e01c2d16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:44.577984 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-37d8d390-5fda-49f9-8f26-51f3e01c2d16 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102694 Jun 15 19:30:44.579693 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:30:44.592578 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-9043eeb6-e7b2-444a-abd5-dae2eb4bcde5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:44.637698 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-9043eeb6-e7b2-444a-abd5-dae2eb4bcde5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051718 Jun 15 19:30:44.638559 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1335 bytes} [Wed Jun 15 19:30:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:46.919092 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-37d8d390-5fda-49f9-8f26-51f3e01c2d16 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:46.920760 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-37d8d390-5fda-49f9-8f26-51f3e01c2d16 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Jun 15 19:30:46.926522 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:46 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:47.107408 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2a053aee-5f7f-44dc-a772-3e0cf88a1c05 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:47.172217 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-2a053aee-5f7f-44dc-a772-3e0cf88a1c05 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.243976 Jun 15 19:30:47.173968 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1291 bytes} [Wed Jun 15 19:30:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:30:49.372861 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-37d8d390-5fda-49f9-8f26-51f3e01c2d16 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:49.373950 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-37d8d390-5fda-49f9-8f26-51f3e01c2d16 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 15 19:30:49.374632 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:30:49.437851 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-bb1c8cd4-0f64-4a5b-96da-50477fb5d017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "1"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:49.456605 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-bb1c8cd4-0f64-4a5b-96da-50477fb5d017 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075482 Jun 15 19:30:49.457142 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:30:49.469883 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-b5d3779c-c0ff-4475-89dc-4e0249380a5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:49.495186 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-b5d3779c-c0ff-4475-89dc-4e0249380a5f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028709 Jun 15 19:30:49.496038 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1332 bytes} [Wed Jun 15 19:30:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:51.865391 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-bb1c8cd4-0f64-4a5b-96da-50477fb5d017 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:51.866478 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-bb1c8cd4-0f64-4a5b-96da-50477fb5d017 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 15 19:30:51.866846 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:51.942222 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-65f92ca3-60dd-4e8b-a71a-199766773b19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "disk": 20}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:51.964525 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-65f92ca3-60dd-4e8b-a71a-199766773b19 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091201 Jun 15 19:30:51.965682 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:30:51.977383 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-00c0ed66-83ca-47af-9654-4fcad6867e03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:52.001497 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-00c0ed66-83ca-47af-9654-4fcad6867e03 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027856 Jun 15 19:30:52.002076 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1332 bytes} [Wed Jun 15 19:30:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:54.175245 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-65f92ca3-60dd-4e8b-a71a-199766773b19 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:54.176623 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-65f92ca3-60dd-4e8b-a71a-199766773b19 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Jun 15 19:30:54.177218 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:54.241260 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5bee8917-f92e-423c-8bdb-09fa7ca3cccc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:54.264346 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5bee8917-f92e-423c-8bdb-09fa7ca3cccc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078580 Jun 15 19:30:54.265390 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:30:54.281367 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-782e1233-0cd3-4ceb-ab63-aa2700ce584a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:54.311503 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-782e1233-0cd3-4ceb-ab63-aa2700ce584a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035426 Jun 15 19:30:54.317631 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1332 bytes} [Wed Jun 15 19:30:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:30:56.468838 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5bee8917-f92e-423c-8bdb-09fa7ca3cccc admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:56.469951 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5bee8917-f92e-423c-8bdb-09fa7ca3cccc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 15 19:30:56.470475 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:56.528221 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-9bb8c359-edf2-4a12-9eba-3a50e9eeae0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "vcpus": 4, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:56.545847 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-9bb8c359-edf2-4a12-9eba-3a50e9eeae0f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069629 Jun 15 19:30:56.546603 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:30:56.558212 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-0eb0edb7-bdb2-4696-adcc-7b0b8950f91e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:56.580432 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-0eb0edb7-bdb2-4696-adcc-7b0b8950f91e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025954 Jun 15 19:30:56.581186 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1332 bytes} [Wed Jun 15 19:30:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:30:58.784640 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-9bb8c359-edf2-4a12-9eba-3a50e9eeae0f admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:30:58.785661 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-9bb8c359-edf2-4a12-9eba-3a50e9eeae0f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 15 19:30:58.786323 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:30:58.847716 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-4db24b36-f856-4be4-a282-a23385d2e275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "swap": 0, "name": "m1.xlarge"}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:58.868285 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-4db24b36-f856-4be4-a282-a23385d2e275 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075654 Jun 15 19:30:58.869524 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1282 bytes} [Wed Jun 15 19:30:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:30:58.882074 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-3a572ba0-01cc-4039-aed9-784e52670172 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:30:58.905282 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-3a572ba0-01cc-4039-aed9-784e52670172 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027275 Jun 15 19:30:58.906228 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1332 bytes} [Wed Jun 15 19:30:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:31:23.207278 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-4db24b36-f856-4be4-a282-a23385d2e275 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:23.208280 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-4db24b36-f856-4be4-a282-a23385d2e275 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 15 19:31:23.208671 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:23.219465 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:31:23.269097 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-7d3be797-fad7-412a-87a9-f304e34ca1aa admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:23.286301 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-7d3be797-fad7-412a-87a9-f304e34ca1aa admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071405 Jun 15 19:31:23.286840 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1291 bytes} [Wed Jun 15 19:31:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:31:24.264197 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-4db24b36-f856-4be4-a282-a23385d2e275 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:24.265191 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-4db24b36-f856-4be4-a282-a23385d2e275 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 15 19:31:24.265580 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:24.461075 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-56d82d4d-a24e-47a4-930c-f67c665885c5 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:24.467148 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.wsgi [None req-56d82d4d-a24e-47a4-930c-f67c665885c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-56d82d4d-a24e-47a4-930c-f67c665885c5 admin admin] Request method failure captured: Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Accept: application/json Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Accept-Encoding: gzip, deflate Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Connection: keep-alive Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Content-Length: 0 Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Host: 10.222.0.15 Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Openstack-Api-Version: compute 2.90 Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Openstack-System-Scope: None Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: User-Agent: python-novaclient Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Auth-Token: gAAAAABiqjOMy2p7LilTCVmF0I9N3LjZ6p3hFFNDTv7hSyWAub3manlxLHPRP8CTRwyZAlDSy0fbBoJTp6McjSIEFLJgU0piTHBJy5ATmiKMx6SG6v6Nba78pBa1i0IN4zNlnC1iDvjOLRphsMy-MtgWPzALWENym6PasVsEZRPlwDj4s5NUIXA Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Domain-Id: None Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Domain-Name: None Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Identity-Status: Confirmed Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Is-Admin-Project: True Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Domain-Id: default Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Domain-Name: Default Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Name: admin Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Role: member,reader,admin Jun 15 19:31:24.470394 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Roles: member,reader,admin Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d07be90a27c40718a346a1d9e5469b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d07be90a27c40718a346a1d9e5469b4"}]}] Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant: admin Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant-Name: admin Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User: admin Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Domain-Id: default Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Domain-Name: Default Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Id: d018cc34dbeb4d56a3052de5c20b961c Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Name: admin Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: method: > Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: exception: Flavor 42 could not be found. Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: action_args: {'id': '42'} Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:31:24.472031 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:24.473117 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.474556 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-56d82d4d-a24e-47a4-930c-f67c665885c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:31:24.475822 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-56d82d4d-a24e-47a4-930c-f67c665885c5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062228 Jun 15 19:31:24.475822 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Jun 15 19:31:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 19:31:24.481113 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-df4cbefa-eab6-4d2d-890e-fbe89d9c7ff1 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:24.484113 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:31:24.503292 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-df4cbefa-eab6-4d2d-890e-fbe89d9c7ff1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025648 Jun 15 19:31:24.503819 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Jun 15 19:31:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:31:24.513676 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-0bbcf913-9a2d-4e34-ab3b-5523902bd4d1 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:24.534990 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-0bbcf913-9a2d-4e34-ab3b-5523902bd4d1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025281 Jun 15 19:31:24.535515 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Jun 15 19:31:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:31:24.545364 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5b793b84-31d1-4f32-ad82-bf6be3fa4aac admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:24.551385 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-5b793b84-31d1-4f32-ad82-bf6be3fa4aac admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5b793b84-31d1-4f32-ad82-bf6be3fa4aac admin admin] Request method failure captured: Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Accept: application/json Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Connection: keep-alive Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Content-Length: 0 Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Host: 10.222.0.15 Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABiqjOMy2p7LilTCVmF0I9N3LjZ6p3hFFNDTv7hSyWAub3manlxLHPRP8CTRwyZAlDSy0fbBoJTp6McjSIEFLJgU0piTHBJy5ATmiKMx6SG6v6Nba78pBa1i0IN4zNlnC1iDvjOLRphsMy-MtgWPzALWENym6PasVsEZRPlwDj4s5NUIXA Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Domain-Id: None Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Domain-Name: None Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Name: admin Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Role: member,reader,admin Jun 15 19:31:24.554685 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Roles: member,reader,admin Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d07be90a27c40718a346a1d9e5469b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d07be90a27c40718a346a1d9e5469b4"}]}] Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant: admin Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User: admin Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Id: d018cc34dbeb4d56a3052de5c20b961c Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Name: admin Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: method: > Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: exception: Flavor 42 could not be found. Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: action_args: {'id': '42'} Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:31:24.556016 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:24.556901 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:24.558027 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-5b793b84-31d1-4f32-ad82-bf6be3fa4aac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:31:24.559068 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-5b793b84-31d1-4f32-ad82-bf6be3fa4aac admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015031 Jun 15 19:31:24.559068 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Jun 15 19:31:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 19:31:25.414257 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-0bbcf913-9a2d-4e34-ab3b-5523902bd4d1 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:25.415296 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-0bbcf913-9a2d-4e34-ab3b-5523902bd4d1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 15 19:31:25.415696 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:25.605753 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-953b227d-12d3-4d7c-bdcb-004ec4deb43d admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:25.611154 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-953b227d-12d3-4d7c-bdcb-004ec4deb43d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-953b227d-12d3-4d7c-bdcb-004ec4deb43d admin admin] Request method failure captured: Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Accept: application/json Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Connection: keep-alive Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Content-Length: 0 Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Host: 10.222.0.15 Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABiqjON4Kqi7NvmoOPNEzgCVXoDXOWjJGB2BdBYVErVq9BiEqNi9wXgUGh29D25M6nKbFM666--YdrF9NQu7b6SwPYMaa-mKGT4IHJAECVGi91KAMjHjV9jcy8o3XWMgQkccuSIxuF9w9s83QCd2FoXh8-3qWS075dQ6uAmegHT8OFYoDM Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Domain-Id: None Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Domain-Name: None Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Name: admin Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Role: member,reader,admin Jun 15 19:31:25.612637 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Roles: member,reader,admin Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d07be90a27c40718a346a1d9e5469b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d07be90a27c40718a346a1d9e5469b4"}]}] Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant: admin Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User: admin Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Id: d018cc34dbeb4d56a3052de5c20b961c Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Name: admin Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: method: > Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: exception: Flavor 84 could not be found. Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: action_args: {'id': '84'} Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:31:25.614181 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:25.615109 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.616502 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-953b227d-12d3-4d7c-bdcb-004ec4deb43d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:31:25.617748 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-953b227d-12d3-4d7c-bdcb-004ec4deb43d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060618 Jun 15 19:31:25.617748 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Jun 15 19:31:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 19:31:25.624125 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-65856cdc-d3cb-4f84-8e16-03441f0f0fa1 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:25.638303 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-65856cdc-d3cb-4f84-8e16-03441f0f0fa1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017727 Jun 15 19:31:25.638822 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Jun 15 19:31:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:31:25.647674 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-75cca427-696d-4680-a482-e451fcd895b0 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:25.661145 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-75cca427-696d-4680-a482-e451fcd895b0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016842 Jun 15 19:31:25.661664 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Jun 15 19:31:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:31:25.670468 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-4354135b-ac81-4e9c-ba82-b8c75da405cd admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:25.675654 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.wsgi [None req-4354135b-ac81-4e9c-ba82-b8c75da405cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-4354135b-ac81-4e9c-ba82-b8c75da405cd admin admin] Request method failure captured: Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Accept: application/json Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Accept-Encoding: gzip, deflate Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Connection: keep-alive Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Content-Length: 0 Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Host: 10.222.0.15 Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Openstack-Api-Version: compute 2.90 Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Openstack-System-Scope: None Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: User-Agent: python-novaclient Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Auth-Token: gAAAAABiqjON4Kqi7NvmoOPNEzgCVXoDXOWjJGB2BdBYVErVq9BiEqNi9wXgUGh29D25M6nKbFM666--YdrF9NQu7b6SwPYMaa-mKGT4IHJAECVGi91KAMjHjV9jcy8o3XWMgQkccuSIxuF9w9s83QCd2FoXh8-3qWS075dQ6uAmegHT8OFYoDM Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Domain-Id: None Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Domain-Name: None Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Identity-Status: Confirmed Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Is-Admin-Project: True Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Domain-Id: default Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Domain-Name: Default Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Name: admin Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Role: member,reader,admin Jun 15 19:31:25.677149 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Roles: member,reader,admin Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d07be90a27c40718a346a1d9e5469b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d07be90a27c40718a346a1d9e5469b4"}]}] Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant: admin Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant-Name: admin Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User: admin Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Domain-Id: default Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Domain-Name: Default Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Id: d018cc34dbeb4d56a3052de5c20b961c Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Name: admin Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: method: > Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: exception: Flavor 84 could not be found. Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: action_args: {'id': '84'} Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:31:25.678701 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:25.679480 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:25.680685 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-4354135b-ac81-4e9c-ba82-b8c75da405cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:31:25.682601 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-4354135b-ac81-4e9c-ba82-b8c75da405cd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011412 Jun 15 19:31:25.682601 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Jun 15 19:31:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 19:31:26.539762 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-75cca427-696d-4680-a482-e451fcd895b0 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:26.540828 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-75cca427-696d-4680-a482-e451fcd895b0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 15 19:31:26.541254 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:26.729487 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-c3833421-4339-4eea-bc67-5c9c56fac622 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:26.736681 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.wsgi [None req-c3833421-4339-4eea-bc67-5c9c56fac622 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-c3833421-4339-4eea-bc67-5c9c56fac622 admin admin] Request method failure captured: Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Accept: application/json Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Accept-Encoding: gzip, deflate Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Connection: keep-alive Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Content-Length: 0 Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Host: 10.222.0.15 Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Openstack-Api-Version: compute 2.90 Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Openstack-System-Scope: None Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: User-Agent: python-novaclient Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Auth-Token: gAAAAABiqjOOrueDlrDKLCi6LvS2J2X0G4NyBZnaJfHhNosxDsQzBbrZkXbF2-G7k0hdWY_ebosqq3ohhvNn0H2T4orxkzfONYXLm9fP5XBYZoTA7ZgyLRV0pAR6myhF2F-uPkcGYaJODBJkIBIT3BQBMGIIqBRASuf3yOWtpOUTyelnKP-t3cc Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Domain-Id: None Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Domain-Name: None Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Identity-Status: Confirmed Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Is-Admin-Project: True Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Domain-Id: default Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Domain-Name: Default Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Project-Name: admin Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Role: member,reader,admin Jun 15 19:31:26.738209 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Roles: member,reader,admin Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d07be90a27c40718a346a1d9e5469b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d07be90a27c40718a346a1d9e5469b4"}]}] Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant: admin Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-Tenant-Name: admin Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User: admin Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Domain-Id: default Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Domain-Name: Default Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Id: d018cc34dbeb4d56a3052de5c20b961c Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: X-User-Name: admin Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: method: > Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: exception: Flavor 451 could not be found. Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: action_args: {'id': '451'} Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:31:26.739716 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:26.740783 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.742166 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-c3833421-4339-4eea-bc67-5c9c56fac622 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:31:26.743390 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-c3833421-4339-4eea-bc67-5c9c56fac622 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061227 Jun 15 19:31:26.743390 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Jun 15 19:31:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 19:31:26.749650 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-dd44c641-56fa-4a62-9002-082ac0141cef admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:26.764749 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-dd44c641-56fa-4a62-9002-082ac0141cef admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018564 Jun 15 19:31:26.765255 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Jun 15 19:31:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:31:26.774481 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:26.787830 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016866 Jun 15 19:31:26.788347 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Jun 15 19:31:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:31:26.797708 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8663e96a-8789-4213-8609-fcf9937f3b12 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:26.802910 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.wsgi [None req-8663e96a-8789-4213-8609-fcf9937f3b12 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8663e96a-8789-4213-8609-fcf9937f3b12 admin admin] Request method failure captured: Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Accept: application/json Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Accept-Encoding: gzip, deflate Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Connection: keep-alive Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Content-Length: 0 Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Host: 10.222.0.15 Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Openstack-Api-Version: compute 2.90 Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Openstack-System-Scope: None Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: User-Agent: python-novaclient Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Auth-Token: gAAAAABiqjOOrueDlrDKLCi6LvS2J2X0G4NyBZnaJfHhNosxDsQzBbrZkXbF2-G7k0hdWY_ebosqq3ohhvNn0H2T4orxkzfONYXLm9fP5XBYZoTA7ZgyLRV0pAR6myhF2F-uPkcGYaJODBJkIBIT3BQBMGIIqBRASuf3yOWtpOUTyelnKP-t3cc Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Domain-Id: None Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Domain-Name: None Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Identity-Status: Confirmed Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Is-Admin-Project: True Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Domain-Id: default Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Domain-Name: Default Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Project-Name: admin Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Role: member,reader,admin Jun 15 19:31:26.804393 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Roles: member,reader,admin Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7d07be90a27c40718a346a1d9e5469b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7d07be90a27c40718a346a1d9e5469b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7d07be90a27c40718a346a1d9e5469b4"}]}] Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant: admin Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant-Id: 7d07be90a27c40718a346a1d9e5469b4 Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-Tenant-Name: admin Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User: admin Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Domain-Id: default Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Domain-Name: Default Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Id: d018cc34dbeb4d56a3052de5c20b961c Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: X-User-Name: admin Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: method: > Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: exception: Flavor 451 could not be found. Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: action_args: {'id': '451'} Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:31:26.805668 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:26.806560 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: ERROR nova.api.openstack.wsgi Jun 15 19:31:26.807683 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-8663e96a-8789-4213-8609-fcf9937f3b12 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103331) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:31:26.808688 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-8663e96a-8789-4213-8609-fcf9937f3b12 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011378 Jun 15 19:31:26.808688 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Jun 15 19:31:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 19:31:27.671984 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:27.672984 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 15 19:31:27.673371 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:27.862700 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-cc4af11c-12cd-471d-b2c7-57c6103083db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:31:27.879372 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-cc4af11c-12cd-471d-b2c7-57c6103083db admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069469 Jun 15 19:31:27.879908 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Jun 15 19:31:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:31:28.740153 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:28.741159 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 15 19:31:28.741554 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:28.929156 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-e36aaf90-fd72-459c-a5b9-8b7b6be8363f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:31:28.945632 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-e36aaf90-fd72-459c-a5b9-8b7b6be8363f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066994 Jun 15 19:31:28.946183 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Jun 15 19:31:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:31:29.798160 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:29.799152 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 15 19:31:29.799545 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:29.987010 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-d01c030a-d10a-4960-a8cc-6e2d702393a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:31:30.004242 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-d01c030a-d10a-4960-a8cc-6e2d702393a7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067831 Jun 15 19:31:30.004777 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Jun 15 19:31:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:31:30.860569 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:30.861559 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jun 15 19:31:30.861952 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:31:31.048823 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-4185aac5-7ca0-4bec-a088-4932ac17033a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:31:31.067754 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-4185aac5-7ca0-4bec-a088-4932ac17033a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069710 Jun 15 19:31:31.068279 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Jun 15 19:31:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:31:31.923019 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:31.924024 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 15 19:31:31.924413 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:31:32.112270 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-001d79a5-081c-47eb-8248-0007d5ea0b0c admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:31:32.131847 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-001d79a5-081c-47eb-8248-0007d5ea0b0c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070252 Jun 15 19:31:32.132383 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Wed Jun 15 19:31:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:32:19.456187 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:32:19.457206 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-5e766aa7-7017-403d-a493-c5f9e39ad50e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 15 19:32:19.457768 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 930 bytes} [Wed Jun 15 19:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:32:19.468250 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:32:19.519752 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2f775ab3-c107-448a-a868-4b2c6c60b67f admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:32:19.540680 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-2f775ab3-c107-448a-a868-4b2c6c60b67f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076885 Jun 15 19:32:19.541230 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1291 bytes} [Wed Jun 15 19:32:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:32:19.565546 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-a76a1022-e84d-4f03-9a66-189c9458a792 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:32:19.569001 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG dbcounter [-] [103332] Writing DB stats nova_api:SELECT=14 {{(pid=103332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:32:19.574782 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-a76a1022-e84d-4f03-9a66-189c9458a792 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012933 Jun 15 19:32:19.575329 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1282 bytes} [Wed Jun 15 19:32:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:32:19.587774 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-b8074ade-d605-4427-9f96-394d9c3f3475 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:32:19.595580 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-b8074ade-d605-4427-9f96-394d9c3f3475 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011913 Jun 15 19:32:19.596113 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1285 bytes} [Wed Jun 15 19:32:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:32:19.608017 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:32:19.615962 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011651 Jun 15 19:32:19.616635 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1285 bytes} [Wed Jun 15 19:32:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:32:19.629006 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-15c12c05-f48b-48c5-b2b9-da538fb632ec admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:32:19.637428 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-15c12c05-f48b-48c5-b2b9-da538fb632ec admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012350 Jun 15 19:32:19.637914 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1282 bytes} [Wed Jun 15 19:32:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:35:42.713501 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:42.714545 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 15 19:35:42.714972 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:35:42.871164 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=6 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:35:42.983839 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-fa5471e1-b570-438e-b355-e035caabe6cc admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:42.985036 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:35:42.985036 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: warnings.warn(msg) Jun 15 19:35:42.986269 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-fa5471e1-b570-438e-b355-e035caabe6cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:42.986716 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-fa5471e1-b570-438e-b355-e035caabe6cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:42.987510 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-fa5471e1-b570-438e-b355-e035caabe6cc admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:42.988455 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-fa5471e1-b570-438e-b355-e035caabe6cc admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:43.022291 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-fa5471e1-b570-438e-b355-e035caabe6cc admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152534 Jun 15 19:35:43.022837 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Jun 15 19:35:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:35:43.890126 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:43.891216 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jun 15 19:35:43.891608 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:35:44.090277 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2fb99c25-2ca7-4a53-a023-d343ebf544be admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:44.091492 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:35:44.091492 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: warnings.warn(msg) Jun 15 19:35:44.092717 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2fb99c25-2ca7-4a53-a023-d343ebf544be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:44.093156 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2fb99c25-2ca7-4a53-a023-d343ebf544be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:44.093943 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2fb99c25-2ca7-4a53-a023-d343ebf544be admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:44.094403 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2fb99c25-2ca7-4a53-a023-d343ebf544be admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:44.114615 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-2fb99c25-2ca7-4a53-a023-d343ebf544be admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076296 Jun 15 19:35:44.115180 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Jun 15 19:35:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:35:55.380656 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:55.383619 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 15 19:35:55.383619 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:35:55.526403 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell0:SELECT=4 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:35:55.527039 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_cell1:SELECT=4 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:35:55.527652 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG dbcounter [-] [103331] Writing DB stats nova_api:SELECT=8 {{(pid=103331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:35:55.574986 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-667126c9-6f24-4bb3-ac61-ed06bd520f82 admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:55.576134 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:35:55.576134 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: warnings.warn(msg) Jun 15 19:35:55.577325 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-667126c9-6f24-4bb3-ac61-ed06bd520f82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:55.577758 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-667126c9-6f24-4bb3-ac61-ed06bd520f82 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:55.578571 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-667126c9-6f24-4bb3-ac61-ed06bd520f82 admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:55.578996 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-667126c9-6f24-4bb3-ac61-ed06bd520f82 admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:55.604048 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-667126c9-6f24-4bb3-ac61-ed06bd520f82 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082127 Jun 15 19:35:55.604578 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Jun 15 19:35:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:35:56.473851 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: DEBUG nova.api.openstack.wsgi [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] Calling method '>' {{(pid=103332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:56.474880 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: INFO nova.api.openstack.requestlog [None req-2154ca7f-7fed-4b88-844a-29c79d7a6237 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 15 19:35:56.475272 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: [pid: 103332|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Jun 15 19:35:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:35:56.662246 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG nova.api.openstack.wsgi [None req-2f56d778-3998-4c82-bbbd-3a8dff4009bc admin admin] Calling method '>' {{(pid=103331) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:35:56.663405 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 19:35:56.663405 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: warnings.warn(msg) Jun 15 19:35:56.664568 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2f56d778-3998-4c82-bbbd-3a8dff4009bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:56.665011 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2f56d778-3998-4c82-bbbd-3a8dff4009bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:56.665796 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2f56d778-3998-4c82-bbbd-3a8dff4009bc admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:35:56.666249 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: DEBUG oslo_concurrency.lockutils [None req-2f56d778-3998-4c82-bbbd-3a8dff4009bc admin admin] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103331) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:35:56.687798 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: INFO nova.api.openstack.requestlog [None req-2f56d778-3998-4c82-bbbd-3a8dff4009bc admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077161 Jun 15 19:35:56.688331 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: [pid: 103331|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Jun 15 19:35:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:36:55.488650 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: Wed Jun 15 19:36:55 2022 - graceful shutdown triggered... Jun 15 19:36:55.489173 dv-cinder-844563-3-iscsi devstack@n-api.service[103331]: Gracefully killing worker 1 (pid: 103331)... Jun 15 19:36:55.488752 dv-cinder-844563-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 19:36:55.489988 dv-cinder-844563-3-iscsi devstack@n-api.service[103332]: Gracefully killing worker 2 (pid: 103332)... Jun 15 19:36:56.489765 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: worker 1 buried after 1 seconds Jun 15 19:36:56.490233 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: worker 2 buried after 1 seconds Jun 15 19:36:56.490233 dv-cinder-844563-3-iscsi devstack@n-api.service[103330]: goodbye to uWSGI. Jun 15 19:36:56.491422 dv-cinder-844563-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 19:36:56.491970 dv-cinder-844563-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 19:36:56.494793 dv-cinder-844563-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 19:36:56.506843 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 19:36:56 2022] *** Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: nodename: dv-cinder-844563-3-iscsi Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: machine: x86_64 Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: clock source: unix Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: pcre jit disabled Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: detected number of CPU cores: 4 Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: current working directory: / Jun 15 19:36:56.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: detected binary path: /usr/bin/uwsgi-core Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: your processes number limit is 47680 Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: your memory page size is 4096 bytes Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: detected max file descriptor number: 2048 Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: lock engine: pthread robust mutexes Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: thunder lock: enabled Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 19:36:56.509527 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 19:36:56.553230 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: Python main interpreter initialized at 0x55b1b377c9c0 Jun 15 19:36:56.553230 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: python threads support enabled Jun 15 19:36:56.553230 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: your server socket listen backlog is limited to 100 connections Jun 15 19:36:56.553230 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: your mercy for graceful operations on workers is 90 seconds Jun 15 19:36:56.553696 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 19:36:56.553696 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: *** Operational MODE: preforking *** Jun 15 19:36:56.553955 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: *** uWSGI is running in multiple interpreter mode *** Jun 15 19:36:56.553955 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: spawned uWSGI master process (pid: 129315) Jun 15 19:36:56.554200 dv-cinder-844563-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 19:36:56.554741 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: spawned uWSGI worker 1 (pid: 129333, cores: 1) Jun 15 19:36:56.555254 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: spawned uWSGI worker 2 (pid: 129334, cores: 1) Jun 15 19:36:56.556534 dv-cinder-844563-3-iscsi devstack@n-api.service[129315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 19:36:57.208449 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 19:36:57.217756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 19:36:58.456633 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:36:58.456633 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: from cryptography.utils import int_from_bytes Jun 15 19:36:58.457264 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:36:58.457264 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: from cryptography.utils import int_from_bytes Jun 15 19:36:58.470880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:36:58.470880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: from cryptography.utils import int_from_bytes Jun 15 19:36:58.471414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 19:36:58.471414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: from cryptography.utils import int_from_bytes Jun 15 19:37:00.878750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 19:37:00.879372 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 19:37:00.879649 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 19:37:00.879909 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 19:37:00.880168 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 19:37:00.880557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.880890 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.881218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.881544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.881880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.882216 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.882549 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.882875 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.883210 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.883476 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.883796 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.884445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-3-iscsi {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.884445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.884757 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.885071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.885398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.885722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.886035 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.886370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.886876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.888615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.888940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.889276 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.889651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.889957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.890314 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.890653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.891010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.891354 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.891680 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.892103 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-3-iscsi {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.892602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.893105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.893426 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.893860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.894213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.894456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 19:37:00.894876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.894954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 19:37:00.895040 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.895273 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 19:37:00.895392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.895469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.895551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 19:37:00.895763 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 19:37:00.895886 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.896109 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.896232 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.896437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.896558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.896764 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.896880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.897071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.897179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.897403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.897516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.897703 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.897816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898027 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898391 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898494 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898675 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898789 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.898941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.899046 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.899240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.899398 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.899618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.899780 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-3-iscsi {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.899927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.900083 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.900236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.900380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.900558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.900714 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.900859 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901149 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901295 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901606 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.901903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.902055 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.902258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.902414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.902576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.902731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.902877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.903050 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.903208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.903361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.903521 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.903673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.903843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.904924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.905077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.905223 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.905375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.905521 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.905678 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.905840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-3-iscsi {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.906170 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.906328 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.906516 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.906664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.906823 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.906989 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.907134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.907286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.907450 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.907602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.907756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.907903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908055 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908221 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908682 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908835 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.908981 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.909125 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.909277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.909432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.909578 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.909730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.909883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910050 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910222 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910382 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910672 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.910969 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.911122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.911277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.911423 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.911567 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.911711 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.911866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912190 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912632 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.912945 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.913091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.913246 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.913409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.913564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.913710 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.913874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914034 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914215 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914513 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.914983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.915135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.915287 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.915432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.915591 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.915753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.915904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.916075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.916389 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.916550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.916709 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.916866 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917475 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917784 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.917947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.918153 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.918306 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.918452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.918596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.918751 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.918904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919058 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919348 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919493 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919807 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.919963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.920118 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.920272 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.920418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.920570 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.920726 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.920878 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921030 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921175 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921691 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921838 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.921993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.922694 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.922850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.922994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.923153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.923298 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.923444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.923598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.923744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.923912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.924992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.925144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.925289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.925440 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.925592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.925758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.925905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.926050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.926230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.926230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.926712 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.926870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.927016 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.927167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.927323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.927468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.927621 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.927773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.927929 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.928074 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.928225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.928372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.928534 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.928679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.928833 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.928986 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.929131 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.929275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.929429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.929581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.929733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.929884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.930030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.930217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.930398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.930545 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.930697 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.930851 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.931011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.931167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.931319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.931470 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.931623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.931775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.931920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.932064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.932064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.932363 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.932525 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.932671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.932823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.932968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.933114 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.933257 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.933414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.933558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.933710 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.933861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.934008 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.934185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.934353 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.934498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.934643 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.934786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.934941 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.935094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.935247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.935398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.935550 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.935700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.935845 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.936004 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.936149 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.936315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.936478 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.936780 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.936943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.937104 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.937258 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.937258 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.937540 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.940609 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.940803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.940974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.941132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.941278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.941442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.941588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.941744 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.941898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.942056 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.942240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 19:37:00.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.942533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.942685 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.942830 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.942988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.943148 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.943315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.943461 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.943614 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.943773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.943928 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944241 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944693 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.944992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.945145 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.945432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.945584 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.945745 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.945891 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.946036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.946218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.946388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.946533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.946715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947660 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947660 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.947947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.948092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.948237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.948382 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.949133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.949841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.950010 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.950247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.950408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.950574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.950789 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.951022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.951022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.951598 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.951848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.951848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.952338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.952585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.952585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953495 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.953945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.954992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.955289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.955448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.955601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.955753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.955753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.956129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.956377 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.956647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.956902 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.957300 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.957563 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.957842 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.958313 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.958603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.958773 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.958930 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959085 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.959974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.960128 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.960128 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.960438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.960591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.960591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.960867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961611 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961764 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.961918 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.962077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.962252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.962409 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.962555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.962711 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.962857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963312 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.963903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964491 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964665 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964743 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.964989 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965474 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.965877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966008 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966808 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.966981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.967066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.967165 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.969651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.969765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.969856 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.969942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.970027 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.970129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.971789 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.971906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972187 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972377 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972462 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972898 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.972983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973168 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973253 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973610 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973695 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973778 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973874 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.973959 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974049 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974499 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974771 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.974953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975045 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975295 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975461 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975650 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975741 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.975917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976447 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976714 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976807 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976895 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.976978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977163 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977349 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977441 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977631 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977717 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977801 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977884 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.977966 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978261 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978430 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978512 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978595 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978691 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.978942 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979362 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979445 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979535 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979619 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979715 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979807 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.979966 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980037 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980107 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980271 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980447 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980624 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980720 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980888 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.980977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981061 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981228 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981536 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981680 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981855 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.981996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.982222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.982317 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.982562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.982654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.982886 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.982977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.983213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.983305 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.983529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.983621 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.983847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.983945 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.984160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.984253 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.984477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.985249 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.985393 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.985558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.985649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.985722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.985932 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.986025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.986273 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.986591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.986962 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.987139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.987292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.987451 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.987678 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.987846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.987996 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.988146 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.988301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.988461 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.988624 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.988782 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.988932 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.989098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.989248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.989395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.990770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.991044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.991121 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.991454 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.991639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.991797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.991946 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992086 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992186 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992287 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992381 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992467 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992757 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.992865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.993072 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.993174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.993385 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.993485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.993694 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.993838 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.994001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.994155 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.994457 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.994770 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.995077 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.995363 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.995502 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.995685 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.995798 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996013 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996347 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996654 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996875 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.996982 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.997196 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.997293 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.997498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.997596 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.997811 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.997915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.998139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.998247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.998452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.998547 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.998760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.998863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.999068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.999169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.999412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.999504 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.999727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:00.999862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.000035 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.000183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.000914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.001074 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.001241 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.001343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.001554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.001655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.002147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.002249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.002464 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.002568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.002775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.002874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.003090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.003188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.003402 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.003504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.003712 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.003802 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004045 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004184 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004476 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004751 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.004966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.005071 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.005284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.005385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.005595 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.005689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.005908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.006008 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.006248 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.006343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.006554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.006655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.006861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.007007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.007178 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.007280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.007496 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.007754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.007855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.008091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.008184 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.008408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.008506 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.008727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.008832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009036 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009348 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009659 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.009983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.010079 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.010306 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.010399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.010616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.010760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.010946 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011045 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011255 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.011970 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.012176 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.012277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.012483 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.012582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.012785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.012877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.013095 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.013187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.013396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.013488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.013701 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.013809 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014006 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014660 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014762 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.014968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.015070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.015276 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.015377 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.015583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.015693 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.015915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016224 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016695 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.016931 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.017136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.017229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.017461 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.017566 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.017769 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.017868 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.018075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.018238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.018417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.018520 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.018728 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.018830 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.019066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.019158 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.019373 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.019472 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.019697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.019788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020011 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020149 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.020936 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021550 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.021968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.022198 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.022328 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.022529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.022634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.022825 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.022939 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.023133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.023234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.023438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.023531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.023743 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.023846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024058 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024369 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024470 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.024978 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.025072 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.025290 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.025385 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.025604 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.025705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.025908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.026960 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.027176 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.027345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.027501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.027652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.027802 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.027952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028098 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028237 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028384 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028531 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028817 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.028963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.029116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.029262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.029400 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.029565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.029708 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.029865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030303 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030410 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030594 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030802 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.030920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.031114 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.031237 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.031443 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.031548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.031760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.031863 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032061 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032819 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.032988 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.033133 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.033291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.033443 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.033601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.033759 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.033905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.034074 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.034232 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.034419 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.034527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.034737 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.034832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.035048 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.035156 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.035425 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.035535 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.035739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.035841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036047 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036156 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036454 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036659 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.036964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.037071 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.037279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.037395 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.037605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.037699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.037915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038374 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038669 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038881 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.038980 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.039189 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.039282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.039499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.039591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.039804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.039905 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.040120 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.040213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.040433 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.040546 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.040742 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.040910 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041345 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041524 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041660 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.041975 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.042195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.042299 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.042527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.042643 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.042838 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.042940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.043154 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.043265 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.043467 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.043578 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.043795 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.043904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.044122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.044232 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.044430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.044539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.044739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.044841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045045 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045152 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045517 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045677 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.045992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.046129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.046330 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.046442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.046642 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.046767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.046953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.047627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.047806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.047954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.048113 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.048257 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.048419 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.048566 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.048744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.048893 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049497 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049645 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049784 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.049948 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.050117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.050286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.050379 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.050593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.050706 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.050976 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.051075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.051293 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.051438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.051609 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.051723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.051916 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052011 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052224 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052337 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052632 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052840 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.052949 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.053155 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.053250 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.053461 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.053554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.053781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.053883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.054122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.054228 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.054435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.054530 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.054760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.054862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055382 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055475 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.055999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.056100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.056303 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.056402 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.056613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.056776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.056921 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057060 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057224 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.057996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.058243 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.058388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.058560 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.058706 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.058856 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059003 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059197 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059675 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.059963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.060137 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.060292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.060442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.060590 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.060768 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.060908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061057 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061351 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061490 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061648 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.061956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.062063 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.062305 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.062396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.062588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.062736 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.063485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.063591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.063759 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.063861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.064081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.064183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.064394 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.064487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.064703 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.064795 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065500 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065682 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.065976 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.066133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.066350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.066445 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.066672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.066765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.066974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.067066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.067281 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.067376 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.067590 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.067690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.067899 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068084 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068269 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.068906 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.069118 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.069217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.069429 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.069530 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.069735 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.069840 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070178 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070370 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070478 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070690 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.070990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.071084 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.071309 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.071402 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.071620 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.071841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.071946 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.072175 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.072269 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.072495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.072603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.072813 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.072915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.073129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.073229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.073434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.073544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.073738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.073830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.074043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.074156 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.074401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.074509 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.074704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.074796 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075026 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075119 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075458 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075683 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075786 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.075995 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.076087 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.076332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.076426 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.076652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.076744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.076968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.077066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.077287 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.077387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.077607 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.077708 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.077913 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.078071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.078247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.078359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.078586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.078679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.078895 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079007 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079202 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079821 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.079922 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.080128 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.080263 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.080433 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.080594 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.080748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.080919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081383 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081674 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081814 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.081934 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082182 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082281 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082864 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.082980 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.083206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.083308 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.083520 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.083675 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.083844 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.084011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.084162 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.084423 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.084574 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.084746 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.084886 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.085079 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.085220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.085402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.085545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.085721 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.085862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.086038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.086178 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.086385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.086478 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.086714 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.086825 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087013 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087119 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087325 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087419 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087738 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.087949 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088055 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088255 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088377 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088668 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088881 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.088983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.089194 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.089398 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.089520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.089727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.089820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.090040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.090393 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.090498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.090704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.090816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091021 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091431 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091751 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.091978 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092270 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092580 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092891 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.092984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.093200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.093301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.093520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.093645 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.093837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.093960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.094197 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.094307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.094511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.094618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.094826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.094918 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.095142 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.095242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.095449 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.095554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.095765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.095859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.096077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.096177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.096402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.096495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.096711 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.096811 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097122 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097425 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097739 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.097950 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.098049 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.098293 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.098438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.098605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.098696 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.098913 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099019 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099326 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099531 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099630 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099845 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.099948 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.100154 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.100247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.100470 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.100570 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.100779 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.100882 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.101091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.101193 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.101407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.101507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.101763 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.101926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.102071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.102269 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.102404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.102600 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.102708 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.102923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103025 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103668 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103879 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.103980 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.104203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.104303 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.104509 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.104611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.104814 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.105093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.105188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.105419 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.105509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.105723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.105817 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.106045 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.106172 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.106377 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.106481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.106684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.106778 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107104 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107311 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107413 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107636 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107848 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.107941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.108203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.108296 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.108532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.108665 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.108850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.108945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.109162 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.109267 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.109473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.110124 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.110328 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.110436 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.110644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.110748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.110953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111377 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111881 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.111974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.112201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.112300 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.112493 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.112611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.112804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.112899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.113116 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.113217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.113421 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.113515 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.113730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.113830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.114038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.114170 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.114389 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.114491 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.114694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.114794 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115102 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115306 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115399 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115717 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.115927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116097 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116259 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116399 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116540 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116678 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.116964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.117104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.117242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.117407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.117556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.117715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.117875 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118022 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118330 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118829 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.118924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.119144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.119272 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.119468 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.119594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.119780 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.119899 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.120109 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.120209 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.120447 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.120553 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.120779 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.120880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.121108 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.121206 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.121417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.121531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.121724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.121819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.122065 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.122204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.122376 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.122481 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.122698 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.122908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.123009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.123244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.123362 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.123568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.123673 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.123896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124010 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124345 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124622 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124816 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.124907 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.125121 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.125242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.125997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.126146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.126330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.126432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.126639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.126733 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.127201 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.127295 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.127506 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.127599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.127813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.127907 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.128117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.128217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.128425 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.128518 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.128733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.128878 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129037 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129131 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129749 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.129955 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.130054 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.130289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.130397 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.130604 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.130698 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.130940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131683 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.131992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.132204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.132309 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.132513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.132611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.132824 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.132926 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.133133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.133235 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.133442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.133542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.133758 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.133858 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.134076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.134224 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.134412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.134504 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.134720 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.134821 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135138 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135445 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135667 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.135999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.136093 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.136331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.136439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.136641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.136744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.136960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137051 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137271 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137371 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137901 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.137993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.138242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.138344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.138578 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.138684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.138898 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139211 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.139938 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.140123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.140216 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.140431 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.140524 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.140748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.140881 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.141083 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.141176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.141388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.141481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.141694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.141807 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142004 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142336 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.142942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143052 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143854 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.143997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.144157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.144315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.144459 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.144627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.144788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.144899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 19:37:01.145061 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.145363 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.145670 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.145974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.146313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.146618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.146922 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.147225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.147555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.147889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.148206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.148529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.148843 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.149167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.149474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.149794 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.150133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.150455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.150764 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.151097 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.151408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.151725 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.152036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.152347 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.152664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.152968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.153295 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.153619 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.153923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.154283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.154605 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.154927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.155244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.155559 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.155887 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.156205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.157034 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.157354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.157667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.157980 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.158345 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.158663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.158991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.159318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.159628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.159952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.160279 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.160626 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.160941 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.161284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.161611 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.161926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.162262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.162569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 19:37:01.162818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 19:37:01.208694 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO dbcounter [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Registered counter for database nova_api Jun 15 19:37:01.225521 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO dbcounter [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Registered counter for database nova_api Jun 15 19:37:01.229199 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.235820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writer thread running {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.245503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_db.sqlalchemy.engines [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.253207 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writer thread running {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.294183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.context [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4(cell1) {{(pid=129333) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 19:37:01.298479 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:01.300083 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:01.300886 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:01.302891 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:01.304923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO dbcounter [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Registered counter for database nova_cell0 Jun 15 19:37:01.308824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO dbcounter [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Registered counter for database nova_cell1 Jun 15 19:37:01.313750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.context [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4(cell1) {{(pid=129334) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 19:37:01.316725 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.318032 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:01.318509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.319756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:01.320565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:01.322647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:01.324161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writer thread running {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.324682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO dbcounter [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Registered counter for database nova_cell0 Jun 15 19:37:01.329146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO dbcounter [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Registered counter for database nova_cell1 Jun 15 19:37:01.330245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writer thread running {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.336689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_db.sqlalchemy.engines [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.338252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_db.sqlalchemy.engines [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.345113 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writer thread running {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.347233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writer thread running {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.475381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO dbcounter [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Registered counter for database nova_cell0 Jun 15 19:37:01.482950 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.488903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writer thread running {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.495109 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO dbcounter [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Registered counter for database nova_cell0 Jun 15 19:37:01.501651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_db.sqlalchemy.engines [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 19:37:01.506305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writer thread running {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 19:37:01.809770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: WARNING keystonemiddleware.auth_token [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:37:01.816963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: WARNING keystonemiddleware.auth_token [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:37:01.829767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: WARNING keystonemiddleware.auth_token [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:37:01.837000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: WARNING keystonemiddleware.auth_token [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:37:02.162929 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: WARNING keystonemiddleware.auth_token [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:37:02.168889 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: WARNING keystonemiddleware.auth_token [None req-bfa374f1-5e7c-4fb0-9a5d-929605a2504d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:37:02.174190 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1b377c9c0 pid: 129333 (default app) Jun 15 19:37:02.185960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: WARNING keystonemiddleware.auth_token [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 19:37:02.192523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: WARNING keystonemiddleware.auth_token [None req-0ea88626-9be1-46f6-a8fb-0eacf59a974e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 19:37:02.197833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b1b377c9c0 pid: 129334 (default app) Jun 15 19:37:43.859310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:43.862694 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:43.865985 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:43.868382 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:44.911082 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1651108975", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "networks": [{"uuid": "6de6f532-7bff-4678-a647-36475af189c4"}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:37:45.345658 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] validate_networks() for [('6de6f532-7bff-4678-a647-36475af189c4', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:37:47.392062 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:37:47.394260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:37:47.395719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:37:47.396488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:37:47.397124 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:37:47.436993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:47.437996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:47.439128 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:47.439785 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:47.548784 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Getting quotas for project 240ef47b993b48dc9f48932a3c077a9a. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:37:47.565079 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Getting quotas for user c792103be95040719c1772cd8aa1d12f and project 240ef47b993b48dc9f48932a3c077a9a. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:37:47.598061 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:37:47.604380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:37:47.750837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cf62335e-0087-40f4-a02c-cffe62b20e82 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.933129 Jun 15 19:37:47.765066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=3 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:47.765966 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=3 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:47.766571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:37:47.766924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=3 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:47.767636 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=3 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:48.214867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a69adda5-40aa-47f0-9adc-41d2e3271865 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:48.216569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a69adda5-40aa-47f0-9adc-41d2e3271865 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:48.977536 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a69adda5-40aa-47f0-9adc-41d2e3271865 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:49.003241 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a69adda5-40aa-47f0-9adc-41d2e3271865 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1215 microversion: 2.1 time: 1.243509 Jun 15 19:37:49.034888 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:47 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1215 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:50.032148 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:50.032769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:50.065037 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:50.065414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:50.081022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:50.081824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:50.467767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:50.500723 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0e006a5d-b329-4faf-96c2-22740ef8f1ff tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1211 microversion: 2.1 time: 0.473488 Jun 15 19:37:50.517590 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:50 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1211 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:51.529872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:51.531233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:51.543021 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:51.544904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:51.546043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:51.549501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:51.797878 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:51.829722 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c6c0d234-eb87-4f9d-b5bc-078f2ff298a8 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1267 microversion: 2.1 time: 0.309449 Jun 15 19:37:51.830676 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:51 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:52.850901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:52.851632 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:52.863471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:52.868252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:52.870042 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:52.871545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:53.401348 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:53.423647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e0836c25-24a0-4aa8-ab5e-5463aa8aa1cd tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1267 microversion: 2.1 time: 0.578811 Jun 15 19:37:53.427862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:52 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1267 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:54.448167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:54.449527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:54.464003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:54.468650 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:54.469686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:54.470554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:54.733667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:54.743826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-436901b5-c799-4784-9415-4770b1289cef tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1273 microversion: 2.1 time: 0.305146 Jun 15 19:37:54.752443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:54 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:55.772907 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:55.777642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:55.800869 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:55.801337 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:55.805089 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:55.805557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:56.289901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:56.299808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e63a47ae-3471-4913-b012-f7fe51cf201c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1273 microversion: 2.1 time: 0.530479 Jun 15 19:37:56.300474 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:55 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1273 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:56.515674 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-37ab339a-6b66-434a-99bf-f66cb69cd22e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: .version_select at 0x7f16476a2820>, body: {"keypair": {"name": "tempest-keypair-2045709903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoDpHGllvniA7KYc3GpHiZHpiL5pwOrHh9Vyudd5kTwqpZI+X1moc2kgR1m3sj4RklIRPJVOwkimyK6DqY6KgNdc/wnifY7bYp02DbVW/SDeNCogDswods3dvr/XXxi/w=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:37:56.761859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-37ab339a-6b66-434a-99bf-f66cb69cd22e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:37:56.832342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-37ab339a-6b66-434a-99bf-f66cb69cd22e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for user c815423179f44b219e4f8572b10355c0 and project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:37:57.018372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-37ab339a-6b66-434a-99bf-f66cb69cd22e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.684114 Jun 15 19:37:57.032647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 4/8] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:37:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:37:57.317822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:57.319441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:57.336944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:57.338626 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:57.342149 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:57.344293 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:57.485508 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:57.585263 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:37:57.648642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:57.667780 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1f8b92fb-f9b8-48fc-b1f2-6b10e7a19ecf tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1273 microversion: 2.1 time: 0.354536 Jun 15 19:37:57.677482 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:57 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1273 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:37:58.694991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:37:58.695775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:37:58.703391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:58.717777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:58.723412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:37:58.727581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:37:59.050590 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:37:59.083059 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-40375c09-2529-4477-91ff-b81b3cb6c034 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1273 microversion: 2.1 time: 0.371955 Jun 15 19:37:59.090168 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:37:58 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:00.107805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:00.109623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:00.126490 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:00.128092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:00.130253 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:00.133006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:00.329874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:00.350426 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c0170d0a-572f-4c2e-871c-a9528063d62a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1273 microversion: 2.1 time: 0.248922 Jun 15 19:38:00.353527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:00 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:01.371415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:01.372155 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:01.388115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:01.390726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:01.396334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:01.397827 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:01.855469 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-96ed5a48-dafb-4fbb-a371-cddfaaf9825a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'create', calling method: .version_select at 0x7f1646e409d0>, body: {"keypair": {"name": "tempest-keypair-2082348737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEdpHheHRmx7k3usWxHKHsC6i3ul1IIhj0oy0T2V7sDLz0eDcPAbmMyCdEIExO4PgazQWkjeC30jPH5fBbr+d7A7lrIbTxEOUNq5zSHAutrGQlkW094Ct8RrYpR00gbrw=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:01.921844 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-96ed5a48-dafb-4fbb-a371-cddfaaf9825a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for project 71e0c71509f94f158063991e37617894. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:01.951387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-96ed5a48-dafb-4fbb-a371-cddfaaf9825a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for user b2103a7ed6824444a60fa5573e7ad39e and project 71e0c71509f94f158063991e37617894. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:02.063619 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-96ed5a48-dafb-4fbb-a371-cddfaaf9825a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.788762 Jun 15 19:38:02.067321 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 6/12] 10.222.0.15 () {62 vars in 1199 bytes} [Wed Jun 15 19:38:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 793 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 19:38:02.873696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:02.905557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1fb902b3-2e0e-4014-b650-a9ec5c2c657f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 1.531465 Jun 15 19:38:02.916580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:01 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:03.929597 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:03.930692 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:03.948224 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:03.948752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:03.951503 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:03.952120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:04.532331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:04.551115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f811da39-c6bc-4400-8321-78c51da4cc23 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.631747 Jun 15 19:38:04.568850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:03 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:04.582154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1767530981", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:04.762542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] validate_networks() for [('f41991f1-753c-4841-8d77-8c975a43b0cd', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:38:04.887605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1786111989", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68dc56fb-2946-4967-bb27-7b13a758ce58"}], "security_groups": [{"name": "tempest-securitygroup--370565222"}], "key_name": "tempest-keypair-2045709903", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:05.407147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] validate_networks() for [('68dc56fb-2946-4967-bb27-7b13a758ce58', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:38:08.601721 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:38:08.603182 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:38:08.605462 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:38:08.606123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:38:08.607448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:38:08.631871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:08.634066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:08.636611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:08.643113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:08.703908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:08.718274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for user c815423179f44b219e4f8572b10355c0 and project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:08.741299 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:38:08.748030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:38:08.892236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cedea3f9-2187-4bd2-b8fc-4c9c55c15731 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.009395 Jun 15 19:38:08.895730 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 9/15] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:38:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 4015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:38:08.913561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:08.914797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:08.927775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:08.931073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:08.932161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:08.934008 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:09.056026 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=18 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:09.439432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:38:09.440081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:38:09.440696 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:38:09.441393 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:38:09.441805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:38:09.475842 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:09.483636 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:09.485612 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:09.486073 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:09.635315 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:09.688671 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for user f26a832b69564f2a8387215afba6730e and project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:09.754971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:38:09.775474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:38:09.998938 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:10.011118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1fe6ac91-fb4e-473d-82f6-13a065b259b9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 1.113573 Jun 15 19:38:10.015403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 10/16] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:08 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:10.024129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cdd304b8-b068-43f5-bba5-ddd5945c8c22 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.125749 Jun 15 19:38:10.025360 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 7/17] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:38:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 6128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:38:10.051819 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c54a57f9-1826-4016-82e7-f900af6fd014 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:10.070741 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c54a57f9-1826-4016-82e7-f900af6fd014 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:10.272436 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c54a57f9-1826-4016-82e7-f900af6fd014 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:10.301216 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c54a57f9-1826-4016-82e7-f900af6fd014 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1238 microversion: 2.1 time: 0.264662 Jun 15 19:38:10.314234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 11/18] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:10 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1238 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:10.336069 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-640599fb-cdf5-45be-9c35-bea5811c4f85 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:10.337144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-640599fb-cdf5-45be-9c35-bea5811c4f85 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:10.792330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-640599fb-cdf5-45be-9c35-bea5811c4f85 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:10.814565 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-640599fb-cdf5-45be-9c35-bea5811c4f85 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1222 microversion: 2.1 time: 0.497175 Jun 15 19:38:10.822339 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 12/19] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:10 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1222 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:11.027791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7f474015-ac9d-4759-8ca1-7ae1c3e52aec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: .version_select at 0x7f1646e56dc0>, body: {"keypair": {"name": "tempest-keypair-1940220290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5OFofxPfgyxLKvVS3RkD/JjOn9px0t4hbsJTi1FZwCjKnqPsNUHTv9TvnAzX8/LzEi/MZjnAhNcDAliI3ayZxk2GVFxEpSvfiTpyIRmmZDXFylZXpCsKGh8jKf6JecBA=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:11.083629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-7f474015-ac9d-4759-8ca1-7ae1c3e52aec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:11.103731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-7f474015-ac9d-4759-8ca1-7ae1c3e52aec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:11.244270 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7f474015-ac9d-4759-8ca1-7ae1c3e52aec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.217068 Jun 15 19:38:11.245357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 8/20] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:38:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:11.274389 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:11.276992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:11.305779 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:11.306278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:11.308922 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:11.310584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:11.754263 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-9db46a41-1a0c-4c32-848a-8a2db3be6c2f req-2533c627-0499-4091-a4f0-a35e6490d46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6952a579-25ae-414b-b781-0bc2d381f9bd", "tag": "dd397714-88e2-47d3-8487-b40ac7a1dff4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:11.778594 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-9db46a41-1a0c-4c32-848a-8a2db3be6c2f req-2533c627-0499-4091-a4f0-a35e6490d46b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:11.779863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-9db46a41-1a0c-4c32-848a-8a2db3be6c2f req-2533c627-0499-4091-a4f0-a35e6490d46b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:11.847536 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-9db46a41-1a0c-4c32-848a-8a2db3be6c2f req-2533c627-0499-4091-a4f0-a35e6490d46b service nova] Creating event network-changed:dd397714-88e2-47d3-8487-b40ac7a1dff4 for instance 6952a579-25ae-414b-b781-0bc2d381f9bd on hv-cinder-84456 Jun 15 19:38:11.852136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-9db46a41-1a0c-4c32-848a-8a2db3be6c2f req-2533c627-0499-4091-a4f0-a35e6490d46b service nova] Acquired lock "compute-rpcapi-router" {{(pid=129333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 19:38:11.854567 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:11.855246 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:11.857363 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:11.858019 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:11.891501 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.compute.rpcapi [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 19:38:11.892959 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] Releasing lock "compute-rpcapi-router" {{(pid=129333) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 19:38:11.921140 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:11.969237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-875096cf-afd3-4a6f-b245-d0e7cbfdfbc7 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.722482 Jun 15 19:38:11.970367 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 9/21] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:11 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:11.991069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:11.996050 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:11.997613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-606765d5-6f67-49b2-9a9e-613fcd0244ee None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.165056 Jun 15 19:38:11.998560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 13/22] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:12.005357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1990048997", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:12.021031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:12.025894 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:12.026833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:12.027286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:12.123272 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] validate_networks() for [('f41991f1-753c-4841-8d77-8c975a43b0cd', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:38:12.290803 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:12.299872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-338ea845-7443-4512-aeaa-a3aa0c6b8ed3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1242 microversion: 2.1 time: 0.327574 Jun 15 19:38:12.300460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 10/23] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:11 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1242 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:12.323137 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1675769261", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6ca100c-fdac-452a-ad9c-d280af0c139f"}], "security_groups": [{"name": "tempest-securitygroup--2123275406"}], "key_name": "tempest-keypair-2082348737", "user_data": "}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:12.605683 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] validate_networks() for [('f6ca100c-fdac-452a-ad9c-d280af0c139f', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:38:14.301684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:38:14.302280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:38:14.302629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:38:14.303051 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:38:14.303470 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:38:14.329035 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:14.329730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:14.336517 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:14.337014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:14.392409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for project 71e0c71509f94f158063991e37617894. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:14.410791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for user b2103a7ed6824444a60fa5573e7ad39e and project 71e0c71509f94f158063991e37617894. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:14.434021 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:38:14.437145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:38:14.603286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c5fd76e9-75f7-4de0-8ee2-7b09f5a74a93 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.287788 Jun 15 19:38:14.606056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 11/24] 10.222.0.15 () {62 vars in 1187 bytes} [Wed Jun 15 19:38:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 19:38:14.638811 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:38:14.639272 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:38:14.639785 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:38:14.640344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:38:14.640776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:38:14.641613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:14.643382 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:14.644510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:14.667555 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:14.668009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:14.671696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:14.671859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:14.672739 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:14.676546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:14.678629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:14.683341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:14.712136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=57 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:14.765656 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:14.802410 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for user f26a832b69564f2a8387215afba6730e and project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:14.865192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:38:14.885936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:38:15.110435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c1ebf293-d380-499b-8e38-3d432beee348 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.103483 Jun 15 19:38:15.111151 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 14/25] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:38:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:38:15.122627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:15.134144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:15.165873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:15.173914 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:15.175018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:15.175398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:15.432937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:15.459179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d3487f07-cfb6-4288-84ed-e4eed3e12501 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1296 microversion: 2.1 time: 0.345157 Jun 15 19:38:15.462172 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 15/26] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:15 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1296 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:15.477373 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-355bf4ff-9e38-4bf6-acbc-7a40544c035b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:15.479212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-355bf4ff-9e38-4bf6-acbc-7a40544c035b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:15.530560 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:15.543050 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d465d03f-7a19-4f06-90f8-bce0d180df8f tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.932141 Jun 15 19:38:15.545292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 12/27] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:14 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:15.559367 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3d5f96a9-94f0-48ce-b8a2-20310c9d80e3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:15.565503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3d5f96a9-94f0-48ce-b8a2-20310c9d80e3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:15.836506 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-355bf4ff-9e38-4bf6-acbc-7a40544c035b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:15.864513 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-355bf4ff-9e38-4bf6-acbc-7a40544c035b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:15.868662 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-355bf4ff-9e38-4bf6-acbc-7a40544c035b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:15.875183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-355bf4ff-9e38-4bf6-acbc-7a40544c035b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1282 microversion: 2.20 time: 0.408906 Jun 15 19:38:15.877093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 16/28] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:15 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1282 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:15.921547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3d5f96a9-94f0-48ce-b8a2-20310c9d80e3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:15.939718 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3d5f96a9-94f0-48ce-b8a2-20310c9d80e3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1222 microversion: 2.1 time: 0.390174 Jun 15 19:38:15.955437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 13/29] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:15 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1222 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:16.477197 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:16.479082 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:16.492558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:16.503038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:16.505572 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:16.507381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:16.564043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:16.565332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:16.586158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:16.587929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:16.592055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:16.592923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:16.775797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:16.791846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b4a55f09-05b5-49ca-8fa2-a8f62df2dec5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1296 microversion: 2.1 time: 0.315046 Jun 15 19:38:16.796537 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 17/30] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:16 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1296 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:16.903134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:16.903761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:16.911199 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:16.911984 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:16.913756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:16.914455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:17.227941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:17.256319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:17.264248 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:17.270446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-10d734f7-236a-400d-9a77-23fd7ec53da8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1334 microversion: 2.20 time: 0.377476 Jun 15 19:38:17.276544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 18/31] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:16 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1334 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:17.295958 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:17.299509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:17.317567 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:17.318027 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:17.318852 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:17.323853 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:17.642921 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:17.666769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9789ade1-3eb0-48c9-8560-5fa36add081e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1282 microversion: 2.1 time: 0.385175 Jun 15 19:38:17.667810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 19/32] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:17 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1282 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:17.684768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:17.696914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8e709295-dd5e-4cb6-b754-4051c379a675 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 1.139437 Jun 15 19:38:17.700623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 14/33] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:16 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:17.811112 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:17.812218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:17.826383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:17.827086 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:17.828277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:17.828918 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:18.295210 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:18.295826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:18.305214 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:18.309943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:18.310845 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:18.311283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:18.346479 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:18.356745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-eb936761-4a16-4ac3-96db-748707ce629a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.549917 Jun 15 19:38:18.362350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 20/34] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:17 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:18.378153 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-973637547", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ed2ffb-2899-41f6-afeb-0cd1a1d94e79"}], "security_groups": [{"name": "tempest-securitygroup--930492162"}], "key_name": "tempest-keypair-1940220290", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:18.529334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:18.552915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:18.554493 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:18.555640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bc851413-f1e3-44b3-9404-53906d1a3756 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1340 microversion: 2.20 time: 0.264969 Jun 15 19:38:18.556202 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 15/35] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:18 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1340 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:38:18.684612 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:18.685676 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:18.693431 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:18.696216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:18.697167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] validate_networks() for [('25ed2ffb-2899-41f6-afeb-0cd1a1d94e79', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:38:18.700900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:18.703233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:18.704728 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:18.999568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:19.014911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b8e3062f-351c-45ff-a06d-f14d9b740396 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1280 microversion: 2.1 time: 0.334032 Jun 15 19:38:19.017070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 16/36] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:18 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:19.023518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:19.024464 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:19.057044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:19.060494 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:19.063440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:19.064974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:19.505072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:19.520484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-eb241af5-7680-4bef-aa2f-4482aed69f5b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.495902 Jun 15 19:38:19.530961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 17/37] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:19 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:19.536009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:19.540374 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:19.555797 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:19.557532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:19.558576 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:19.560024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:19.964401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:19.975715 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:38:19.976919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:38:19.977558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:38:19.978581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:38:19.979502 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:38:19.992256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-80d9c653-3a6c-4a6b-9597-fefcf7246b14 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.456226 Jun 15 19:38:20.004546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 18/38] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:19 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:20.009081 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.010788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.011835 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.013857 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.016693 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:20.019001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:20.035215 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.035950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.037455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.039770 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.068630 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:38:20.080556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:38:20.105526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:38:20.112938 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:38:20.177205 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-833433dd-98f0-428b-9ec1-3f828e0238c9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.812523 Jun 15 19:38:20.179391 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 21/39] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:38:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:38:20.192442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:20.203218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:20.205628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:20.208537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5880bbbc-ed25-439c-8336-8dbec770e801 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1340 microversion: 2.20 time: 0.202363 Jun 15 19:38:20.209747 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 19/40] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:20 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:20.214967 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:20.216161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:20.232190 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.232750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.234986 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.236428 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.332179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:20.342245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b89becee-b0b2-4903-a875-70629200a216 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1280 microversion: 2.1 time: 0.131013 Jun 15 19:38:20.343914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:20 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:20.350072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-55a01e62-d6f2-46ab-8047-a6441f79edab tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:20.352893 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-55a01e62-d6f2-46ab-8047-a6441f79edab tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:20.453340 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-6324534e-6e4e-416e-ac66-58040f16c200 req-671e8015-3ce5-4a8f-aaac-3a73c8e79073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952a579-25ae-414b-b781-0bc2d381f9bd", "name": "network-vif-plugged", "status": "completed", "tag": "dd397714-88e2-47d3-8487-b40ac7a1dff4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:20.463007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-55a01e62-d6f2-46ab-8047-a6441f79edab tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:20.465637 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=29 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:20.471840 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-6324534e-6e4e-416e-ac66-58040f16c200 req-671e8015-3ce5-4a8f-aaac-3a73c8e79073 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.473851 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-6324534e-6e4e-416e-ac66-58040f16c200 req-671e8015-3ce5-4a8f-aaac-3a73c8e79073 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.477801 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-55a01e62-d6f2-46ab-8047-a6441f79edab tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1241 microversion: 2.1 time: 0.131794 Jun 15 19:38:20.478348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:20 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:20.499428 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-6324534e-6e4e-416e-ac66-58040f16c200 req-671e8015-3ce5-4a8f-aaac-3a73c8e79073 service nova] Creating event network-vif-plugged:dd397714-88e2-47d3-8487-b40ac7a1dff4 for instance 6952a579-25ae-414b-b781-0bc2d381f9bd on hv-cinder-84456 Jun 15 19:38:20.510736 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-6324534e-6e4e-416e-ac66-58040f16c200 req-671e8015-3ce5-4a8f-aaac-3a73c8e79073 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330091 Jun 15 19:38:20.515259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 22/43] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:20.536877 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:20.537491 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:20.550032 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.553315 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.554169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:20.554694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:20.967337 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:20.978077 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8fc1ae6b-aeb1-483e-aa6e-31c0523c0c4d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.444909 Jun 15 19:38:20.983180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-42e90cc2-0e1a-4014-86a7-f208a803033d req-ac704688-a2a4-4d9d-ba40-b1abb9a377ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831dd3a2-1d82-45da-a99f-000c5954e54b", "tag": "bd7a10f2-591a-4870-ae8b-2b8a7ccd8af7"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:20.988874 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:20 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:21.004566 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-42e90cc2-0e1a-4014-86a7-f208a803033d req-ac704688-a2a4-4d9d-ba40-b1abb9a377ca service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.008732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-42e90cc2-0e1a-4014-86a7-f208a803033d req-ac704688-a2a4-4d9d-ba40-b1abb9a377ca service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.016764 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:21.017832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:21.028996 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.032482 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.033732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.035313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.052234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-42e90cc2-0e1a-4014-86a7-f208a803033d req-ac704688-a2a4-4d9d-ba40-b1abb9a377ca service nova] Creating event network-changed:bd7a10f2-591a-4870-ae8b-2b8a7ccd8af7 for instance 831dd3a2-1d82-45da-a99f-000c5954e54b on hv-cinder-84456 Jun 15 19:38:21.057458 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-42e90cc2-0e1a-4014-86a7-f208a803033d req-ac704688-a2a4-4d9d-ba40-b1abb9a377ca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078922 Jun 15 19:38:21.058011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 23/45] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:38:21.228607 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:21.229356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:21.239364 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.247458 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.248343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.248789 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.317457 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:21.358492 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8c2a36d0-964d-45d0-a96b-80f9e8765dac tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.350185 Jun 15 19:38:21.361015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:21 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:21.367587 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:21.369952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:21.387321 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.388172 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.389146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.389979 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.403550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:21.417883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:21.419832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:21.424657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a64d25ff-81b0-4306-8791-828b6d39cdc0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1340 microversion: 2.20 time: 0.197884 Jun 15 19:38:21.425498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:21 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:38:21.490024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:21.497165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:21.498328 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:21.507731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-313ad9ef-35b0-457f-b9f1-0f56819927c1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1280 microversion: 2.1 time: 0.144437 Jun 15 19:38:21.509089 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:21 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:21.521107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.522064 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.523539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:21.524201 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:21.671752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:21.683722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6132fa1b-3aeb-42a0-a9b3-7ddc325760aa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1293 microversion: 2.1 time: 0.191482 Jun 15 19:38:21.686879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 25/49] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:21 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1293 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:21.997907 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:22.000218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:22.016951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.018734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.020563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.021008 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.334308 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:22.348194 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d1d955e8-2cde-41e8-9177-82e82962e702 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.355805 Jun 15 19:38:22.351897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:21 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:22.375911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:22.376712 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:22.401180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.401952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.404653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.405270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.449277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:22.451656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:22.464252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.464907 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.468031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.468901 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.665038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:22.717389 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:22.718933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:22.725802 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4677d186-dd31-43ea-8456-6d496ae93b2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1340 microversion: 2.20 time: 0.285912 Jun 15 19:38:22.726439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:22 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1340 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:38:22.739289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:22.740198 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:22.744654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:22.753772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b44f8ca3-12db-4bab-a7b5-5a0f257d9999 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.382217 Jun 15 19:38:22.756703 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.757359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.758056 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:22 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:22.767905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.770444 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:22.771056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.771536 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:22.787174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.788241 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.789202 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:22.789786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:22.953480 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:22.964717 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e875b759-22ef-44ec-b95c-28fde922d370 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1299 microversion: 2.1 time: 0.204121 Jun 15 19:38:22.975201 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:22 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:23.122590 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-bb945b2d-07bb-480c-9b02-c6b96249e006 req-c54789ca-8f9e-41e9-a2c1-5afc7a5649a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a4ed60-945d-46a9-8f53-ead05148049e", "tag": "957e70e2-59d5-4a89-bd25-2ddff5525782"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:23.138529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-bb945b2d-07bb-480c-9b02-c6b96249e006 req-c54789ca-8f9e-41e9-a2c1-5afc7a5649a3 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.139233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-bb945b2d-07bb-480c-9b02-c6b96249e006 req-c54789ca-8f9e-41e9-a2c1-5afc7a5649a3 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:23.161145 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-bb945b2d-07bb-480c-9b02-c6b96249e006 req-c54789ca-8f9e-41e9-a2c1-5afc7a5649a3 service nova] Creating event network-changed:957e70e2-59d5-4a89-bd25-2ddff5525782 for instance b7a4ed60-945d-46a9-8f53-ead05148049e on hv-cinder-84456 Jun 15 19:38:23.169290 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-bb945b2d-07bb-480c-9b02-c6b96249e006 req-c54789ca-8f9e-41e9-a2c1-5afc7a5649a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050687 Jun 15 19:38:23.170010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:38:23.208484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:23.216509 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=100 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:23.231498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-25ee32b7-3118-40b7-b7f9-a55b189050fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.487840 Jun 15 19:38:23.239660 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 27/55] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:22 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:23.366006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:23.366950 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:23.379615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.381343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:23.384833 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.385677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:23.744372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:23.745165 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:23.752364 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.753223 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:23.754805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.755457 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:23.802030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:23.811270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-888ec0d0-1e84-4136-b63f-f95080c38c14 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.450074 Jun 15 19:38:23.815039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 29/56] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:23 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:23.826335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:23.827170 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:23.843381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.843843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:23.844645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:23.845126 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.279365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:24.292966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e325a005-8335-42e6-911a-ac7178307ed0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.476823 Jun 15 19:38:24.295761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 30/57] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:23 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:24.300644 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:24.327956 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:24.330984 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:24.336304 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:24.336666 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:24.339585 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-feb9a704-9647-457e-bc5c-87d3cd9ab6c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.597505 Jun 15 19:38:24.341794 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 28/58] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:23 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:38:24.354481 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:24.354666 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:24.355232 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.356212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:24.357054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:24.357707 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.369458 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=4 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:24.373886 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:24.376169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.377230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:24.379039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.844558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:24.854650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-64cbe8f3-cbcb-4149-aaea-7d3a9a12175d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.548500 Jun 15 19:38:24.856229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 31/59] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:24 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:24.869210 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:24.870281 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:24.895068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:24.895520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.896299 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:24.899153 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:24.951477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:24.965869 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-46915c77-2b2a-4aa4-aaaa-ac120b2d3e77 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.621609 Jun 15 19:38:24.967741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 29/60] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:24 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:25.147881 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:25.165961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-faf12fa5-3da7-4442-ae46-ff93ebbbfb1d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.306956 Jun 15 19:38:25.167168 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 32/61] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:24 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:25.313158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:25.314707 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:25.326827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:25.327450 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:25.334833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:25.335569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:25.363141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:25.363937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:25.370117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:25.374428 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:25.375247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:25.375946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:25.660464 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:25.669286 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:25.679325 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b950734b-1a4f-4b6f-af62-57f547efbe43 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.370742 Jun 15 19:38:25.682575 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 30/62] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:25 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:25.684858 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:25.687394 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:25.689529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3c095ae1-fbd9-447c-856c-ee20e1cea116 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.330563 Jun 15 19:38:25.694383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 33/63] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:25 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:25.873872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:25.875131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:25.890915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:25.891826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:25.894774 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:25.895623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:26.068365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-77d8336b-5dc4-4650-885e-30c7207b2d62 req-c8476057-dc74-4264-b4d6-de9c01ebcd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d725dd8-b126-49c5-8d0f-3a02cb3331d2", "tag": "30a09c0c-5cec-4b08-8e71-71e48f7bd23a"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:26.083720 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-77d8336b-5dc4-4650-885e-30c7207b2d62 req-c8476057-dc74-4264-b4d6-de9c01ebcd4f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:26.087176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-77d8336b-5dc4-4650-885e-30c7207b2d62 req-c8476057-dc74-4264-b4d6-de9c01ebcd4f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:26.108408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-77d8336b-5dc4-4650-885e-30c7207b2d62 req-c8476057-dc74-4264-b4d6-de9c01ebcd4f service nova] Creating event network-changed:30a09c0c-5cec-4b08-8e71-71e48f7bd23a for instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 on hv-cinder-84456 Jun 15 19:38:26.118596 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-77d8336b-5dc4-4650-885e-30c7207b2d62 req-c8476057-dc74-4264-b4d6-de9c01ebcd4f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162385 Jun 15 19:38:26.133848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 34/64] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:26.142941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:26.143901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:26.156643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:26.160608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:26.161772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:26.162265 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:26.259342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:26.272484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-345fb7d1-aca9-4e22-b1c5-784425acf330 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.402127 Jun 15 19:38:26.273703 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:25 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:26.280640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:26.281378 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:26.291888 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:26.292745 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:26.294858 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:26.295557 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.117700 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.125959 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-460242c8-735d-4a2b-bc8a-3cc8c073174e tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1315 microversion: 2.1 time: 0.850728 Jun 15 19:38:27.131596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 32/66] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:26 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:27.145252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-48d7e9f9-f678-4c0a-9ace-009bf0695fd8 req-0af1c3d5-e49e-4369-81c1-2fd37a3e1823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3306831f-c20a-46c5-acaa-5420a83ae130", "tag": "47e168a5-c1f1-42dd-b5ac-e995fc3c66c4"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:27.166816 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-48d7e9f9-f678-4c0a-9ace-009bf0695fd8 req-0af1c3d5-e49e-4369-81c1-2fd37a3e1823 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.167504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-48d7e9f9-f678-4c0a-9ace-009bf0695fd8 req-0af1c3d5-e49e-4369-81c1-2fd37a3e1823 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.212335 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-48d7e9f9-f678-4c0a-9ace-009bf0695fd8 req-0af1c3d5-e49e-4369-81c1-2fd37a3e1823 service nova] Creating event network-changed:47e168a5-c1f1-42dd-b5ac-e995fc3c66c4 for instance 3306831f-c20a-46c5-acaa-5420a83ae130 on hv-cinder-84456 Jun 15 19:38:27.212995 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-48d7e9f9-f678-4c0a-9ace-009bf0695fd8 req-0af1c3d5-e49e-4369-81c1-2fd37a3e1823 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129334) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 19:38:27.214452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.214896 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.216230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.216653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.234593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.compute.rpcapi [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 19:38:27.235818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] Releasing lock "compute-rpcapi-router" {{(pid=129334) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 19:38:27.270855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.275029 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=100 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:27.282775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d602f282-c795-42ad-b8cd-383828cbf0b0 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149734 Jun 15 19:38:27.283387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 33/67] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:27.289486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:27.290205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:27.290524 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-52f7fc29-9424-4ede-8f95-e8c9f9d1f409 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 1.154212 Jun 15 19:38:27.304073 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.304442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 35/68] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:26 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:27.304534 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.305348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.305771 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.313543 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:27.314435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:27.335738 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.342387 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.344644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.345295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.553838 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.558280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.566770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.568327 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.568479 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6cd983fc-4506-4d8c-bc69-d77c4a0b4596 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.282913 Jun 15 19:38:27.569317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 34/69] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:27 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:27.569553 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-712cfb95-aad6-437a-8f43-56b8e469f30f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.264031 Jun 15 19:38:27.570297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:27 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:27.584550 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:27.585338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:27.591504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.591946 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.592704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:27.593130 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:27.723526 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:27.731487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-73729258-be2a-4ecd-a83f-c5f7ab4bf2a3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.160849 Jun 15 19:38:27.732086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 35/71] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:27 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:28.147901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:28.148559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:28.158070 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.158331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.159321 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.159996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.294331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.301845 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d0d571b7-f780-4695-8f56-200d00ecfa3c tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1501 microversion: 2.1 time: 0.158350 Jun 15 19:38:28.305165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 37/72] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:28 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:28.318916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:28.333532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:28.347029 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.348119 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.348975 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.349546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.492963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.501755 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e688b862-59ff-46f4-9937-4f7c86efb902 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.186726 Jun 15 19:38:28.502672 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 36/73] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:28 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:28.591554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:28.591801 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:28.592161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:28.592418 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:28.598466 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.598634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.598953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.599358 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.599716 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.600134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.600341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.600551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.803403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.812632 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.814549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.815848 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-43734366-512f-4495-ae84-4d424195f013 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.228077 Jun 15 19:38:28.816485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 37/74] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:28 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:28.820900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:28.821496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:28.827390 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.827832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.828582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:28.829007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:28.836741 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.845295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-78178b56-e5e8-4558-aac2-9fdbaa6e31d8 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.257453 Jun 15 19:38:28.845891 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:28 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:28.971559 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:28.980817 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ed7438bf-ffe9-497e-8528-60b62506d8ad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.163259 Jun 15 19:38:28.981819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 38/76] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:28 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:29.327869 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-97a259d3-471c-4810-8e66-29b28bd66bf8 req-d595cf6f-a134-4fbb-a39b-749b4655ae65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:29.335959 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-97a259d3-471c-4810-8e66-29b28bd66bf8 req-d595cf6f-a134-4fbb-a39b-749b4655ae65 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.336649 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-97a259d3-471c-4810-8e66-29b28bd66bf8 req-d595cf6f-a134-4fbb-a39b-749b4655ae65 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:29.347887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-97a259d3-471c-4810-8e66-29b28bd66bf8 req-d595cf6f-a134-4fbb-a39b-749b4655ae65 service nova] Creating event network-changed:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:38:29.353093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-97a259d3-471c-4810-8e66-29b28bd66bf8 req-d595cf6f-a134-4fbb-a39b-749b4655ae65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029414 Jun 15 19:38:29.353686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 39/77] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:29.518937 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:29.519548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:29.525531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.525974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:29.526760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.527192 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:29.654505 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:29.662991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-39d82f75-9d35-4e31-9b0c-fe4a3f593aae tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.147800 Jun 15 19:38:29.672808 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 39/78] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:29 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:29.834809 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:29.836044 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:29.856460 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.857396 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:29.858479 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.859103 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:29.862996 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:29.863592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:29.872852 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.873365 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:29.874479 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:29.875087 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.045135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=8 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:30.094647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=24 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:30.290067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:30.292133 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:30.299446 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e2fe3c7f-e243-49a7-8d1b-4dae86ab8b1c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.440308 Jun 15 19:38:30.300105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 40/79] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:29 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:30.304738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:30.305743 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:30.313199 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:30.314976 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.315965 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:30.316571 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.318865 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:30.347682 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:30.349368 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-de86b58e-04b6-45b5-bee7-3d6ecd38c6e1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.518708 Jun 15 19:38:30.352090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 40/80] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:29 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:30.474017 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:30.680616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:30.681233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:30.690564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:30.691277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.692400 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:30.693429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.825978 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:30.834334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-43ba55f6-21fb-4298-bf4b-693a50bf163c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.532973 Jun 15 19:38:30.834917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 41/81] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:30 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:30.848937 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "347b8ddc-ebc6-4172-8380-1cc14e08eb3e"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:30.850062 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:30.857653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:30.857653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.858053 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:30.858522 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:30.904964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:30.913000 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-18e069af-8a2e-4791-b7f6-323d0b513f54 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.236239 Jun 15 19:38:30.913557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 41/82] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:30 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:31.316518 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:31.317217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:31.323340 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:31.323791 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:31.324584 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:31.325015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:31.459407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:31.467141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1a136616-0361-4955-8810-855e42a51a3c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.154408 Jun 15 19:38:31.468105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 42/83] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:31 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:31.472530 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:31.473139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:31.478861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:31.479309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:31.480071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:31.481017 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:31.633244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:31.642415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:31.644309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:31.645507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-27da665a-cb08-4ec8-8e3b-c940c6289dae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.176484 Jun 15 19:38:31.646317 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 43/84] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:31 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:31.852035 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:31.852872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:31.860883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:31.861505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:31.862592 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:31.863331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.084054 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:32.094220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-75c5c21a-6d5f-4b11-8823-f4d6e88471f2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.246417 Jun 15 19:38:32.095552 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 44/85] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:31 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:32.111518 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:32.111518 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:32.123544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.124003 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.124783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.125441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.509720 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:32.518662 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1d42320e-c63e-4e87-bb94-571dd0ec85f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.421736 Jun 15 19:38:32.520559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 45/86] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:32 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:32.525554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-1c2e4ff5-2a1f-444f-a97d-df0952f17a2e req-4bcf9595-1b3e-41c1-9d31-2d993e3c9cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831dd3a2-1d82-45da-a99f-000c5954e54b", "name": "network-vif-plugged", "status": "completed", "tag": "bd7a10f2-591a-4870-ae8b-2b8a7ccd8af7"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:32.534667 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1c2e4ff5-2a1f-444f-a97d-df0952f17a2e req-4bcf9595-1b3e-41c1-9d31-2d993e3c9cd5 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.535514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1c2e4ff5-2a1f-444f-a97d-df0952f17a2e req-4bcf9595-1b3e-41c1-9d31-2d993e3c9cd5 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.548290 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-1c2e4ff5-2a1f-444f-a97d-df0952f17a2e req-4bcf9595-1b3e-41c1-9d31-2d993e3c9cd5 service nova] Creating event network-vif-plugged:bd7a10f2-591a-4870-ae8b-2b8a7ccd8af7 for instance 831dd3a2-1d82-45da-a99f-000c5954e54b on hv-cinder-84456 Jun 15 19:38:32.554143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-1c2e4ff5-2a1f-444f-a97d-df0952f17a2e req-4bcf9595-1b3e-41c1-9d31-2d993e3c9cd5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Jun 15 19:38:32.555484 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 46/87] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:32.563002 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:32.564560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:32.573395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.574719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.577557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.578229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.637409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-47a83445-be37-4607-b8b2-99a4f2353b96 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "POST /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.791528 Jun 15 19:38:32.651312 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 42/88] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:38:30 2022] POST /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd/os-volume_attachments => generated 194 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:32.664399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:32.665261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:32.684056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.684754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.685689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:32.686329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:32.712407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:32.845375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:32.853627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-319fd6aa-66af-465a-9c40-f753623aaa91 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.296513 Jun 15 19:38:32.864472 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 47/89] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:32 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:32.879746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:32.888866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:32.890442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:32.891563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c5b48ec7-6b2e-4d67-a965-63b08a34e095 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.231921 Jun 15 19:38:32.892124 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 43/90] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:32 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:33.119146 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:33.119871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:33.127639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:33.128267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:33.129221 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:33.129864 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:33.280710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:33.292866 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e156f308-51ad-49bd-a81a-baafd419a1f4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.177587 Jun 15 19:38:33.294026 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 48/91] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:33 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:33.537712 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:33.538474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:33.549367 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:33.551020 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:33.566206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:33.570865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:33.883460 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:33.884073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:33.897521 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:33.901388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:33.902034 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:33.903128 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:33.903781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:33.962237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:33.977403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4c8c9f55-d3d0-4a67-8e66-cf1e0607368c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.439565 Jun 15 19:38:33.980123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 44/92] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:33 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:33.992280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:33.994229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:34.020145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:34.021010 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:34.022193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:34.024991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:34.281372 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:34.291397 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9e01c61d-841e-4e71-9e2e-4d812f585eb4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.414189 Jun 15 19:38:34.294788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 49/93] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:33 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:34.313116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:34.314454 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:34.324341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:34.334189 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:34.335817 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:34.336297 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:34.337376 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:34.337802 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:34.343963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:34.345639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a1c03869-d88c-49d0-8ee1-e69c0f77d43a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.364270 Jun 15 19:38:34.348474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 45/94] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:33 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:34.592065 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-8526d52d-93b3-4d70-a142-b5ca34583e96 req-823b6540-f8fc-4aef-8dd0-9d59b7cf7897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a4ed60-945d-46a9-8f53-ead05148049e", "name": "network-vif-plugged", "status": "completed", "tag": "957e70e2-59d5-4a89-bd25-2ddff5525782"}, {"server_uuid": "3306831f-c20a-46c5-acaa-5420a83ae130", "name": "network-vif-plugged", "status": "completed", "tag": "47e168a5-c1f1-42dd-b5ac-e995fc3c66c4"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:34.610008 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-8526d52d-93b3-4d70-a142-b5ca34583e96 req-823b6540-f8fc-4aef-8dd0-9d59b7cf7897 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:34.612742 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-8526d52d-93b3-4d70-a142-b5ca34583e96 req-823b6540-f8fc-4aef-8dd0-9d59b7cf7897 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:34.648438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:34.658744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-8526d52d-93b3-4d70-a142-b5ca34583e96 req-823b6540-f8fc-4aef-8dd0-9d59b7cf7897 service nova] Creating event network-vif-plugged:957e70e2-59d5-4a89-bd25-2ddff5525782 for instance b7a4ed60-945d-46a9-8f53-ead05148049e on hv-cinder-84456 Jun 15 19:38:34.659954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7f269f9c-3975-4404-8ccb-9c24276103fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.352845 Jun 15 19:38:34.660784 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-8526d52d-93b3-4d70-a142-b5ca34583e96 req-823b6540-f8fc-4aef-8dd0-9d59b7cf7897 service nova] Creating event network-vif-plugged:47e168a5-c1f1-42dd-b5ac-e995fc3c66c4 for instance 3306831f-c20a-46c5-acaa-5420a83ae130 on hv-cinder-84456 Jun 15 19:38:34.671596 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 50/95] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:34 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:34.683919 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-8526d52d-93b3-4d70-a142-b5ca34583e96 req-823b6540-f8fc-4aef-8dd0-9d59b7cf7897 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096322 Jun 15 19:38:34.686642 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 46/96] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:34.999914 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:35.000876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:35.018672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.018672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.018672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.018672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.202565 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:35.213226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-10812114-61ab-4b58-b2ce-9a6b63f7f8b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.221024 Jun 15 19:38:35.214139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 51/97] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:34 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:35.313446 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:35.314167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:35.320713 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.322594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.325051 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.326379 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.369241 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:35.369848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:35.380573 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.381995 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.385653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.387738 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.563527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:35.574898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cd7d7a57-a8e2-414b-be21-11b7655f4782 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.266446 Jun 15 19:38:35.576772 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 47/98] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:35 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:35.618896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:35.633192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:35.635575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:35.637262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-350568fc-2f52-4b37-915f-f0fffb09b0e0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.274582 Jun 15 19:38:35.637992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 52/99] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:35 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:38:35.679963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:35.680737 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:35.687905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.688565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.689485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:35.690064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:35.889562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:35.900301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-02bac8ec-e08f-4a26-8acd-86f4659016e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.224204 Jun 15 19:38:35.901412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 48/100] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:35 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:36.234177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:36.234880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:36.241121 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.241811 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.242657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.243088 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.392142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:36.394352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=100 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:36.401647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3330dba4-6a8e-4a1f-9f5c-fda945453400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1322 microversion: 2.1 time: 0.174540 Jun 15 19:38:36.402976 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 53/101] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:36 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:36.593328 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:36.594723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:36.601329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.601772 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.602711 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.603466 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.654143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:36.655000 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:36.662332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.663039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.664016 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.664670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.811862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:36.819916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c7e97446-2a8f-487d-a6c8-1203f507728c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1363 microversion: 2.1 time: 0.230730 Jun 15 19:38:36.820496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 49/102] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:36 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:36.849930 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:36.858979 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:36.860475 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:36.861568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-356ee13b-d090-4aa6-b70f-e48573248deb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.211450 Jun 15 19:38:36.871900 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 54/103] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:36 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:36.921228 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:36.922287 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:36.963471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.964142 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:36.965656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:36.969263 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.058049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-e3b7d03d-0b3c-42a7-b506-ff937e123232 req-09f2cc69-bde9-49f3-ba55-24a4dfdd56c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d725dd8-b126-49c5-8d0f-3a02cb3331d2", "name": "network-vif-plugged", "status": "completed", "tag": "30a09c0c-5cec-4b08-8e71-71e48f7bd23a"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:37.069988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-e3b7d03d-0b3c-42a7-b506-ff937e123232 req-09f2cc69-bde9-49f3-ba55-24a4dfdd56c9 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.073994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-e3b7d03d-0b3c-42a7-b506-ff937e123232 req-09f2cc69-bde9-49f3-ba55-24a4dfdd56c9 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.093750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-e3b7d03d-0b3c-42a7-b506-ff937e123232 req-09f2cc69-bde9-49f3-ba55-24a4dfdd56c9 service nova] Creating event network-vif-plugged:30a09c0c-5cec-4b08-8e71-71e48f7bd23a for instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 on hv-cinder-84456 Jun 15 19:38:37.128365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-e3b7d03d-0b3c-42a7-b506-ff937e123232 req-09f2cc69-bde9-49f3-ba55-24a4dfdd56c9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074996 Jun 15 19:38:37.130228 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 55/104] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:38:37.232341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:37.274786 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:37.285225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5bb90615-131d-41b4-8576-51972f06dead tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.372083 Jun 15 19:38:37.286402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 50/105] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:36 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:37.421615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:37.422876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:37.432985 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.435624 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.437083 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.438926 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.634420 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:37.646672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f9f8dfe0-5331-428d-b4f9-8a56fc4face3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1515 microversion: 2.1 time: 0.230213 Jun 15 19:38:37.658956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 56/106] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:37 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:37.667422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:37.669359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:37.675632 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.676082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.676935 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.677328 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.703529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'flavor' on Instance uuid 3306831f-c20a-46c5-acaa-5420a83ae130 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:38:37.838785 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:37.845719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:37.852215 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-caf162db-ee66-410b-86bf-a31e63b05335 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130/action" status: 200 len: 32 microversion: 2.1 time: 0.188805 Jun 15 19:38:37.853049 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 51/107] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:38:37 2022] POST /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:38:37.859306 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.860111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.863141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.864117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.865084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:37.866061 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:37.876868 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.877514 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:37.878407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:37.879353 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.120020 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:38.123749 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:38.141213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-407bb1d4-3aa9-4e12-a415-0a5118d16f71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.277892 Jun 15 19:38:38.146448 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 52/108] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:37 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:38.153551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:38.154239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:38.161565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:38.161565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.162319 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:38.163150 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.168602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cfed9bd2-b389-4fe6-a420-2239a7964e66 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1550 microversion: 2.1 time: 0.332093 Jun 15 19:38:38.194342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 57/109] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:37 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1550 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:38.201652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:38.202166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:38.209932 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:38.210417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.211508 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:38.211944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.371651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6cd90d4f-bd02-43ac-8b85-da950240ea87 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175420 Jun 15 19:38:38.372914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:38.373127 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 58/110] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:38:38 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:38.387699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:38.387699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:38.388325 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:38.393118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:38.393580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.394385 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:38.394825 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:38.397323 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:38.398569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-49b0b7ee-700b-4fe6-8c0b-42f2d2ad3e52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.250265 Jun 15 19:38:38.399152 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 53/111] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:38 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:38.800920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:38.809286 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-574977d5-6eb8-4381-8fa7-35ace3ecd7ca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.434944 Jun 15 19:38:38.810323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 59/112] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:38 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:39.164304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:39.165152 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:39.176900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.182597 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:39.184232 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.184777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:39.234306 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-204700e7-e5d0-4146-90a1-8a0dea777a23 req-fe4fcd66-f7a4-4023-8ba7-2fdb3eb75292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "name": "network-vif-plugged", "status": "completed", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:39.250757 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-204700e7-e5d0-4146-90a1-8a0dea777a23 req-fe4fcd66-f7a4-4023-8ba7-2fdb3eb75292 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.251207 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-204700e7-e5d0-4146-90a1-8a0dea777a23 req-fe4fcd66-f7a4-4023-8ba7-2fdb3eb75292 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:39.264046 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-204700e7-e5d0-4146-90a1-8a0dea777a23 req-fe4fcd66-f7a4-4023-8ba7-2fdb3eb75292 service nova] Creating event network-vif-plugged:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:38:39.269872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-204700e7-e5d0-4146-90a1-8a0dea777a23 req-fe4fcd66-f7a4-4023-8ba7-2fdb3eb75292 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040617 Jun 15 19:38:39.271028 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 60/113] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:38:39.417075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:39.418350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:39.436234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.436863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:39.437823 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.438642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:39.816965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:39.832869 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:39.834060 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:39.838457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:39.840145 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-59b04109-b13e-42e5-93de-af5e0d9ecc8d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.427306 Jun 15 19:38:39.842591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 61/114] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:39 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:38:39.848009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-aee8584c-e730-437e-ba4d-d16f04e833b1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.680519 Jun 15 19:38:39.848800 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 54/115] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:39 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:39.860161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:39.860885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:39.874107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.875582 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:39.876364 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:39.877382 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:40.280631 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:40.290871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ddeb9db3-ded0-4ea1-b92e-1dafeea37d02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.447010 Jun 15 19:38:40.291438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 62/116] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:39 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:40.610710 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-4e3ba5d2-5ac9-48e5-b0a9-603d312901e5 req-35b2176e-d3f4-4fd3-9f7d-5724b2081317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a4ed60-945d-46a9-8f53-ead05148049e", "tag": "957e70e2-59d5-4a89-bd25-2ddff5525782"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:40.630022 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-4e3ba5d2-5ac9-48e5-b0a9-603d312901e5 req-35b2176e-d3f4-4fd3-9f7d-5724b2081317 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:40.630409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-4e3ba5d2-5ac9-48e5-b0a9-603d312901e5 req-35b2176e-d3f4-4fd3-9f7d-5724b2081317 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:40.657896 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-4e3ba5d2-5ac9-48e5-b0a9-603d312901e5 req-35b2176e-d3f4-4fd3-9f7d-5724b2081317 service nova] Creating event network-changed:957e70e2-59d5-4a89-bd25-2ddff5525782 for instance b7a4ed60-945d-46a9-8f53-ead05148049e on hv-cinder-84456 Jun 15 19:38:40.667628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-4e3ba5d2-5ac9-48e5-b0a9-603d312901e5 req-35b2176e-d3f4-4fd3-9f7d-5724b2081317 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060306 Jun 15 19:38:40.669062 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 55/117] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:40.858577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:40.859690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:40.866551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:40.866907 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:40.867510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:40.867654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:40.868744 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:40.869170 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:40.878989 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:40.879672 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:40.880684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:40.881485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:41.118914 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:41.128816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:41.131132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:41.132233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f29849e4-2fbe-4be3-9d78-e296bee44274 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.277522 Jun 15 19:38:41.132775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 63/118] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:40 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:41.183790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:41.192307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-237010fb-b991-4c88-a33e-6885703f0d92 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.330892 Jun 15 19:38:41.193863 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 56/119] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:40 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:41.309393 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:41.310076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:41.320381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:41.321973 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:41.324781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:41.326749 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:41.627810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:41.639459 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6e4dcc08-cd0e-4db3-9f08-e04094c5783c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1366 microversion: 2.1 time: 0.334969 Jun 15 19:38:41.641247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 64/120] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:41 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:42.150773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:42.151438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:42.162254 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.164094 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.165130 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.169997 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.211409 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:42.212203 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:42.225847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.228706 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.232591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.233113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.583556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:42.593104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:42.594650 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:42.595984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1b97173a-163c-40cf-b315-e62341c26e2c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.449084 Jun 15 19:38:42.608756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 57/121] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:42 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:42.647935 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:42.657641 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:42.660945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:42.669292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-281d2f0c-670a-40e0-b650-d46b0bc29507 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.461041 Jun 15 19:38:42.672334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 65/122] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:42 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:42.678322 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.679112 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.680215 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.682879 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.943002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:42.957477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5476a5bc-1169-41cf-bcd6-1b17fcabeb0a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1555 microversion: 2.1 time: 0.303854 Jun 15 19:38:42.958718 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 58/123] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:42 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1555 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:42.980874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:42.981874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:42.989950 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.993066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:42.994121 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:42.997198 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:43.147684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9938cc05-29c6-4207-b384-1edfdafe2b55 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175215 Jun 15 19:38:43.148592 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 66/124] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:38:42 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:43.616402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:43.617001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:43.632505 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:43.633176 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:43.638896 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:43.639538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:43.662713 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:43.692297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:43.695472 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:43.711252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:43.712664 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:43.713637 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:43.717086 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:44.224492 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:44.239108 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:44.241052 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:44.242596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1a6220ec-3b55-4fda-8d23-9274af2dbbf2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1408 microversion: 2.20 time: 0.629935 Jun 15 19:38:44.243399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 59/125] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:43 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1408 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:44.248827 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:44.251343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:44.251884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:44.259917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:44.261409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:44.261934 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-2900741e-d9c6-45bd-86c6-c5bc0d0f6502 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.577441 Jun 15 19:38:44.264256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 67/126] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:43 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:44.273847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:44.274953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:44.324804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:38:44.442900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fbdfe58e-ba8e-4170-98c1-1f30ed88921d tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 204 len: 0 microversion: 2.1 time: 0.197896 Jun 15 19:38:44.444834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 60/127] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:38:44 2022] DELETE /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:38:44.455684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:44.456334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:44.466486 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:44.467563 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:44.468537 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:44.469410 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:44.729022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:44.742509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ca5c78e1-f4b7-40ea-8718-4d0ae6c0eb51 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1553 microversion: 2.1 time: 0.293503 Jun 15 19:38:44.743090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 68/128] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:44 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:45.080127 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-9b5afe5b-c904-4a83-995c-3467f69cce23 req-3f6e3c8e-adce-4f77-a45e-08c8437f0d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d725dd8-b126-49c5-8d0f-3a02cb3331d2", "tag": "30a09c0c-5cec-4b08-8e71-71e48f7bd23a"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:45.093822 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-9b5afe5b-c904-4a83-995c-3467f69cce23 req-3f6e3c8e-adce-4f77-a45e-08c8437f0d98 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.094712 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-9b5afe5b-c904-4a83-995c-3467f69cce23 req-3f6e3c8e-adce-4f77-a45e-08c8437f0d98 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.121785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-9b5afe5b-c904-4a83-995c-3467f69cce23 req-3f6e3c8e-adce-4f77-a45e-08c8437f0d98 service nova] Creating event network-changed:30a09c0c-5cec-4b08-8e71-71e48f7bd23a for instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 on hv-cinder-84456 Jun 15 19:38:45.128162 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-9b5afe5b-c904-4a83-995c-3467f69cce23 req-3f6e3c8e-adce-4f77-a45e-08c8437f0d98 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053550 Jun 15 19:38:45.129386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 61/129] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:45.263029 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:45.264015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:45.282068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:45.282332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.282679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.283469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.283728 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:45.283911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.291218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:45.303458 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.311029 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.312572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.313481 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.632509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:45.641136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:45.642662 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:45.643812 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-47aa4379-85c0-4eaf-bc4a-1c11c4939dda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1601 microversion: 2.20 time: 0.386961 Jun 15 19:38:45.644362 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 69/130] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:38:45 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1601 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:38:45.674260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:45.674961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:45.685867 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.686450 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.688517 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.689057 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.777764 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:45.786008 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-899f1add-0fd8-41d9-bf7b-e2c6eeb92cb8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.508735 Jun 15 19:38:45.786885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 62/131] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:45 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:45.791433 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:45.792153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:45.803896 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.804780 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.806076 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:45.808149 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:45.870645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-865a3e19-f9dd-4602-bb6f-f4f69a5dd406 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.199943 Jun 15 19:38:45.870645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 70/132] 10.222.0.15 () {60 vars in 1315 bytes} [Wed Jun 15 19:38:45 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:38:46.002680 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:46.025845 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b82ede1b-37d5-4c6f-b9f3-76d090d8688b tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1553 microversion: 2.1 time: 0.237936 Jun 15 19:38:46.027527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 63/133] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:45 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:46.806966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:46.807689 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:46.819245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:46.822750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:46.824919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:46.826186 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:47.048500 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:47.049250 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:47.070499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:47.072104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:47.074021 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:47.074671 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:47.618547 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:47.643649 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5d7e67f5-6339-4f80-ad5d-f2149a246514 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.840929 Jun 15 19:38:47.644796 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 71/134] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:46 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:47.732051 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:47.744559 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-715ff044-1a00-4f8d-8ea9-836997baf5a5 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1553 microversion: 2.1 time: 0.702333 Jun 15 19:38:47.747397 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 64/135] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:47 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1553 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:48.010484 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-47178856-71bb-47ee-86f3-cf8475685814 req-7ed28fa0-9bd5-47b4-a8b2-c29bd2e0ac4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6952a579-25ae-414b-b781-0bc2d381f9bd", "name": "network-vif-deleted", "tag": "dd397714-88e2-47d3-8487-b40ac7a1dff4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:48.020094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-47178856-71bb-47ee-86f3-cf8475685814 req-7ed28fa0-9bd5-47b4-a8b2-c29bd2e0ac4b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.021225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-47178856-71bb-47ee-86f3-cf8475685814 req-7ed28fa0-9bd5-47b4-a8b2-c29bd2e0ac4b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.046348 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-47178856-71bb-47ee-86f3-cf8475685814 req-7ed28fa0-9bd5-47b4-a8b2-c29bd2e0ac4b service nova] Creating event network-vif-deleted:dd397714-88e2-47d3-8487-b40ac7a1dff4 for instance 6952a579-25ae-414b-b781-0bc2d381f9bd on hv-cinder-84456 Jun 15 19:38:48.054026 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-47178856-71bb-47ee-86f3-cf8475685814 req-7ed28fa0-9bd5-47b4-a8b2-c29bd2e0ac4b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047367 Jun 15 19:38:48.055056 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 72/136] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:48.663669 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:48.665658 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:48.675807 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.676628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.677652 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.678746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.679051 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-be107dd8-341c-4a13-a796-9f08c804fd95 req-53680ff0-a870-4bb0-8d5f-4c9110c894b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:38:48.687855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-be107dd8-341c-4a13-a796-9f08c804fd95 req-53680ff0-a870-4bb0-8d5f-4c9110c894b0 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.688655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-be107dd8-341c-4a13-a796-9f08c804fd95 req-53680ff0-a870-4bb0-8d5f-4c9110c894b0 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.704331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-be107dd8-341c-4a13-a796-9f08c804fd95 req-53680ff0-a870-4bb0-8d5f-4c9110c894b0 service nova] Creating event network-changed:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:38:48.709816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-be107dd8-341c-4a13-a796-9f08c804fd95 req-53680ff0-a870-4bb0-8d5f-4c9110c894b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034642 Jun 15 19:38:48.713519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 73/137] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:38:48.765119 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:48.766332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:48.774915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.775704 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.777410 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.777992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.833830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=100 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:38:48.880993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:48.888944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:48.892175 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lazy-loading 'fault' on Instance uuid 6952a579-25ae-414b-b781-0bc2d381f9bd {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:38:48.926765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:48.946772 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bc5af7ad-755d-4f9e-8425-b9b7e84edbda tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.287033 Jun 15 19:38:48.948098 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 65/138] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:48 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:49.008909 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c792103be95040719c1772cd8aa1d12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240ef47b993b48dc9f48932a3c077a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:49.023334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-31f166af-c867-4bbc-90bd-fc147a17a7f3 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 200 len: 1351 microversion: 2.1 time: 0.264502 Jun 15 19:38:49.033690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 74/139] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:48 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 1351 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:38:49.968669 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:49.969060 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:49.978527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:49.978975 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:49.987684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:49.988379 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:50.040568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:50.049737 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:50.065200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:50.065687 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:50.066516 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:50.066957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:50.099646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] HTTP exception thrown: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Request method failure captured: Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd HTTP/1.1 Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUH3KEiJW6VjfwS5CxjH1pnfZFFXn7wxY02GX4mzeM7OL4yYeYlWtKnW_LDouJ5uiV3cBIN05Q7HzsrDP4_-OSZb4Vtj4oNIwk2b70auwwM91-JXMoVD85QY0sTokWUcmrIHrg-J0ofR4MDUkDMYjiRtBp62Xcw2Jo_NLF2Zys-cek Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:38:50.112581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_240ef47b993b48dc9f48932a3c077a9a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/240ef47b993b48dc9f48932a3c077a9a"}]}] Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: c792103be95040719c1772cd8aa1d12f Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.114165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '6952a579-25ae-414b-b781-0bc2d381f9bd'} Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:38:50.114983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.116291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.121117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Returning 404 to user: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:38:50.123946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-984a7c0e-8cd8-4cb8-a0d1-a069296d4b8a tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 404 len: 111 microversion: 2.1 time: 0.087186 Jun 15 19:38:50.126021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 75/140] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:50 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:38:50.181167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:50.196369 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-47e1cb84-0d1f-4174-8326-fd0b2234bec4 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.235395 Jun 15 19:38:50.198396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 66/141] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:49 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:50.293944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:50.295372 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:50.305604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:50.306380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:50.308595 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:50.309030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:50.322847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] HTTP exception thrown: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Request method failure captured: Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd/os-volume_attachments HTTP/1.1 Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUH3KEiJW6VjfwS5CxjH1pnfZFFXn7wxY02GX4mzeM7OL4yYeYlWtKnW_LDouJ5uiV3cBIN05Q7HzsrDP4_-OSZb4Vtj4oNIwk2b70auwwM91-JXMoVD85QY0sTokWUcmrIHrg-J0ofR4MDUkDMYjiRtBp62Xcw2Jo_NLF2Zys-cek Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:38:50.333538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_240ef47b993b48dc9f48932a3c077a9a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/240ef47b993b48dc9f48932a3c077a9a"}]}] Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: c792103be95040719c1772cd8aa1d12f Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.334911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'server_id': '6952a579-25ae-414b-b781-0bc2d381f9bd'} Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:38:50.335556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:50.336576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:50.339712 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Returning 404 to user: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:38:50.340812 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e1e859b9-1b20-446a-9d7f-c6ae6ef6b9f9 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052222 Jun 15 19:38:50.341887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 76/142] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:38:50 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:38:51.214508 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:51.215139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:51.222643 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:51.223093 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:51.223856 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:51.224290 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:51.359423 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:51.367627 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-895922a9-1507-4547-a7ce-c3394b22d6bf tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.157392 Jun 15 19:38:51.368217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 67/143] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:51 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:51.651101 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:51.652116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:51.662569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:51.662569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:51.662569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:51.662569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:51.675702 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] HTTP exception thrown: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Request method failure captured: Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd HTTP/1.1 Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUH3KEiJW6VjfwS5CxjH1pnfZFFXn7wxY02GX4mzeM7OL4yYeYlWtKnW_LDouJ5uiV3cBIN05Q7HzsrDP4_-OSZb4Vtj4oNIwk2b70auwwM91-JXMoVD85QY0sTokWUcmrIHrg-J0ofR4MDUkDMYjiRtBp62Xcw2Jo_NLF2Zys-cek Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:38:51.675873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_240ef47b993b48dc9f48932a3c077a9a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/240ef47b993b48dc9f48932a3c077a9a"}]}] Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: c792103be95040719c1772cd8aa1d12f Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.677208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '6952a579-25ae-414b-b781-0bc2d381f9bd'} Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:38:51.678047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.679143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.680332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Returning 404 to user: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:38:51.680332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0e6ee0f5-360a-4702-8206-d429404acf00 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 404 len: 111 microversion: 2.1 time: 0.030253 Jun 15 19:38:51.680332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 77/144] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:38:51 2022] DELETE /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:38:51.686576 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:51.687319 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] [instance: 6952a579-25ae-414b-b781-0bc2d381f9bd] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:51.694009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:51.694455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:51.695223 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:51.695656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:51.710459 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] HTTP exception thrown: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Request method failure captured: Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd HTTP/1.1 Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUH3KEiJW6VjfwS5CxjH1pnfZFFXn7wxY02GX4mzeM7OL4yYeYlWtKnW_LDouJ5uiV3cBIN05Q7HzsrDP4_-OSZb4Vtj4oNIwk2b70auwwM91-JXMoVD85QY0sTokWUcmrIHrg-J0ofR4MDUkDMYjiRtBp62Xcw2Jo_NLF2Zys-cek Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:38:51.715331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_240ef47b993b48dc9f48932a3c077a9a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/240ef47b993b48dc9f48932a3c077a9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/240ef47b993b48dc9f48932a3c077a9a"}]}] Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 240ef47b993b48dc9f48932a3c077a9a Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-DeleteServersTestJSON-1678562075 Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: c792103be95040719c1772cd8aa1d12f Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-DeleteServersTestJSON-1678562075-project Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.716739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '6952a579-25ae-414b-b781-0bc2d381f9bd'} Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:38:51.717688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. Jun 15 19:38:51.719157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:38:51.720538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] Returning 404 to user: Instance 6952a579-25ae-414b-b781-0bc2d381f9bd could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:38:51.720538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8727be4c-15c9-41a0-959f-9f287b24eaa2 tempest-DeleteServersTestJSON-1678562075 tempest-DeleteServersTestJSON-1678562075-project] 10.222.0.15 "GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd" status: 404 len: 111 microversion: 2.1 time: 0.034991 Jun 15 19:38:51.720538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 68/145] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:51 2022] GET /compute/v2.1/servers/6952a579-25ae-414b-b781-0bc2d381f9bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:38:52.384679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:52.385243 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:52.393777 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:52.396899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:52.402536 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:52.403280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:52.661491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:52.669760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-347206e1-74df-4599-8b09-2a52796ac030 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.288888 Jun 15 19:38:52.670381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 78/146] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:52 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:53.686744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:53.687510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:53.704144 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:53.704699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:53.705561 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:53.706005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:53.892664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:53.900460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c4da72e6-253e-45ab-a7a2-8600ca3ce71b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.217436 Jun 15 19:38:53.900953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 69/147] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:53 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:54.918259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:54.918861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:54.925234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:54.925867 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:54.926646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:54.927230 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:55.082642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:55.091384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0b8a0ffd-4593-46f5-9ab8-9cb65d771d9b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.177830 Jun 15 19:38:55.091956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 79/148] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:54 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:56.117410 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:56.123557 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:56.138458 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:56.144067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:56.147146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:56.148564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:56.368173 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:56.382496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5b13c73b-6696-4708-8116-377bc17b49bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.278323 Jun 15 19:38:56.392754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 70/149] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:56 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:57.400095 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:57.401824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:57.408155 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:57.408601 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:57.409524 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:57.409961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:57.557305 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:57.565011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-59f4bdd1-5444-40c7-8ee3-37f57257943a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.168936 Jun 15 19:38:57.565813 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 80/150] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:57 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:58.581971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:58.582599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:58.591398 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:58.592262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:58.593090 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:58.593734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:58.751222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:58.760995 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-36b6c55d-76a7-438d-824c-596ed0b6d4ad tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.182600 Jun 15 19:38:58.761589 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 71/151] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:58 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:38:59.782359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:38:59.786827 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:38:59.794909 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:59.801861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:59.802988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:38:59.803580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:38:59.986873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:38:59.994477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f8867d2a-a30f-410f-9f52-abc6a2a309bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.220807 Jun 15 19:38:59.995269 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 81/152] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:38:59 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:01.012566 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:01.013178 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:01.019403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:01.019931 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:01.020697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:01.021131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:01.151122 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:01.158906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cd673229-c9f4-4ef1-8680-3027e0462162 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.150875 Jun 15 19:39:01.160106 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 72/153] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:01 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:02.176951 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:02.177650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:02.184174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:02.184612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:02.185372 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:02.185797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:02.335289 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:02.343118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7cd15784-ad2d-4e31-8c1d-13bb53befdd8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.170257 Jun 15 19:39:02.343880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 82/154] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:02 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:03.360497 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:03.361747 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:03.370750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:03.370750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:03.370957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:03.371298 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:03.516214 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:03.523866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d76e6fa8-3078-46f0-b14b-10887f546a8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.167457 Jun 15 19:39:03.524431 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 73/155] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:03 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:04.540550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:04.541160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:04.543534 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=70 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:04.548634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:04.549075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:04.549855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:04.550331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:04.676281 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:04.683825 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1934d470-c760-43c4-bd95-d54e0f8ebcb6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.147074 Jun 15 19:39:04.684388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 83/156] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:04 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:05.701339 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:05.702127 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:05.708762 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:05.709235 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:05.709997 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:05.710475 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:05.885256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:05.894283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6dea2f53-e280-4b5d-871f-b351843e7449 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.196694 Jun 15 19:39:05.894857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 74/157] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:05 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:06.911584 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:06.912480 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:06.918994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:06.919659 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:06.920583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:06.921142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:07.065213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:07.073922 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6a048bcd-26f6-4812-916f-0da2b90ca5fb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.166687 Jun 15 19:39:07.074531 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 84/158] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:06 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:39:08.091351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:08.091953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:08.098307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:08.098831 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:08.099656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:08.100114 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:08.241754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:08.245250 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:08.250714 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f5a461c2-7e36-4100-9272-179800cb937e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.163772 Jun 15 19:39:08.251294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 75/159] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:08 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:09.270804 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:09.275020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:09.283186 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:09.283641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:09.284427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:09.284867 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:09.502943 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:09.511947 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-628d97de-2897-4090-8879-f0e299850cea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.245572 Jun 15 19:39:09.513116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 85/160] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:09 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:10.530202 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:10.530806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:10.538262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:10.539086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:10.539950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:10.540273 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:10.692920 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:10.701015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-41a71cf3-f1c1-471d-ac27-4e94d9e90b6f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.176038 Jun 15 19:39:10.701610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 76/161] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:10 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:11.716948 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:11.717550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:11.723609 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:11.723993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:11.724745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:11.725175 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:11.854816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:11.862300 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bcd88d4b-c372-4f11-82eb-0ec7f3f0b690 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.149199 Jun 15 19:39:11.862858 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 86/162] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:11 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:12.879538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:12.880148 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:12.887041 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:12.887659 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:12.888236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:12.888670 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:13.015044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:13.022466 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-06b632db-3197-443b-a27a-0dbffcaefe2e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.146649 Jun 15 19:39:13.023033 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 77/163] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:12 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:14.040219 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:14.040824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:14.048375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:14.048821 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:14.050072 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:14.050527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:14.190700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:14.198756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-2e718f4d-69cd-4151-af4c-f8d87d9180c9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.162305 Jun 15 19:39:14.199321 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 87/164] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:14 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:15.215074 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:15.215683 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:15.222174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:15.222623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:15.223405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:15.223838 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:15.356167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:15.363684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4e18db16-ac2a-409c-9f72-820eeb9534b3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.152435 Jun 15 19:39:15.364244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 78/165] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:15 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:16.380936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:16.381660 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:16.387688 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:16.388134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:16.388914 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:16.389370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:16.514147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:16.521561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-635411be-fc9f-49f0-ab44-49d8972dd8b9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.144470 Jun 15 19:39:16.522141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 88/166] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:16 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:17.538589 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:17.539198 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:17.541501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=34 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:17.546726 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:17.547174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:17.547931 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:17.548361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:17.679954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:17.689408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0653893d-680c-440c-8046-ac42fa72ad41 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.154785 Jun 15 19:39:17.689983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 79/167] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:17 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:18.707454 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:18.707988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:18.714696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:18.715001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:18.715795 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:18.716204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:18.841074 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:18.848522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-528d4703-7a4f-4fc0-8230-9df0051e3f70 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.145046 Jun 15 19:39:18.849084 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 89/168] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:18 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:19.864565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:19.865169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:19.873257 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:19.873705 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:19.874565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:19.875305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:20.023111 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:20.031137 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f6d32e5d-1b46-4bba-815d-c5b49499e4df tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.170538 Jun 15 19:39:20.031696 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 80/169] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:19 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:21.048342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:21.048969 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:21.057444 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:21.057904 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:21.058710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:21.059148 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:21.063648 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=86 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:21.233714 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:21.241660 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7a9dd656-43af-42fa-ad74-efc6e1f1bfa9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.197257 Jun 15 19:39:21.242581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 90/170] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:21 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:22.260697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:22.261420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:22.269141 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:22.269593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:22.270388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:22.270816 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:22.420081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:22.428026 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-27fa4bc9-1d45-49b6-b40a-353c65bd3519 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.172461 Jun 15 19:39:22.428834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 81/171] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:22 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:23.444547 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:23.445151 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:23.451722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:23.452161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:23.452911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:23.453344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:23.604131 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:23.611564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-48b6bb53-f02c-4e07-8d07-7e45a2ab37e6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.170890 Jun 15 19:39:23.612118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 91/172] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:23 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:24.629149 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:24.629671 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:24.636165 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:24.636610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:24.637366 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:24.637797 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:24.765012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:24.772502 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8da01240-0ca8-4481-a4e6-cc83ad33e8ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.147517 Jun 15 19:39:24.773065 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 82/173] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:24 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:25.789271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:25.789884 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:25.796668 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:25.797116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:25.797879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:25.798342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:25.931896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:25.939727 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1f8760ff-8787-4799-bafb-bd8c3df6592c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.154333 Jun 15 19:39:25.940304 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 92/174] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:25 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:26.956984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:26.957593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:26.964375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:26.964851 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:26.965639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:26.966124 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:27.096326 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:27.104384 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7ce02a0d-f564-47ab-8a78-09d6db6dd62c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.151236 Jun 15 19:39:27.104953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 83/175] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:26 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:28.121951 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:28.122538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:28.128902 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:28.129342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:28.130106 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:28.130557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:28.260184 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:28.267788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-569a9efc-d1fa-4f14-919c-66929ad1963f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.150431 Jun 15 19:39:28.268352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 93/176] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:28 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:29.284510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:29.285117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:29.291507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:29.291952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:29.292709 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:29.293141 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:29.433014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:29.440563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fe669334-df1f-4a1b-850f-2e2a10dc6d0b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.159873 Jun 15 19:39:29.441131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 84/177] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:29 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:30.463483 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:30.464090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:30.470071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:30.470546 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:30.471302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:30.471732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:30.606961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:30.614367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a2e6a379-e247-4e76-a024-c4f337081ca8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.155265 Jun 15 19:39:30.614932 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 94/178] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:30 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:31.631475 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:31.631992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:31.637959 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:31.638430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:31.639186 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:31.639618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:31.770913 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:31.779094 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3573ed0a-7a49-4c92-b556-2f20bbdb1995 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1521 microversion: 2.1 time: 0.151674 Jun 15 19:39:31.779663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 85/179] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:31 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:32.796310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:32.796948 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:32.802969 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:32.803415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:32.804169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:32.804603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:32.930380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:32.938316 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-af44d7aa-c274-4008-991a-75035e7f30f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1501 microversion: 2.1 time: 0.145732 Jun 15 19:39:32.938882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 95/180] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:32 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1501 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:32.953898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:32.954573 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:32.961157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:32.961606 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:32.962399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:32.962834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:33.086025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:33.094013 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4076a450-6805-4e32-922b-6cf28832093e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1515 microversion: 2.1 time: 0.143911 Jun 15 19:39:33.094611 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 86/181] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:32 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1515 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:34.440815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:34.441754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:34.448420 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:34.448864 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:34.449621 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:34.450053 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:34.472450 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'flavor' on Instance uuid 831dd3a2-1d82-45da-a99f-000c5954e54b {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:39:34.585908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8dbb0623-e061-437a-b466-94b0b3a8883f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/action" status: 200 len: 32 microversion: 2.1 time: 0.148995 Jun 15 19:39:34.586559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 96/182] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:39:34 2022] POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:39:34.595603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:34.596160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:34.603217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:34.603667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:34.604429 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:34.604862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:34.735941 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:34.743969 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9f288998-8ad3-4e20-baa8-b3463f47cb33 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.152273 Jun 15 19:39:34.744674 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 87/183] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:34 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:35.762696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:35.763297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:35.765238 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=28 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:35.770629 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:35.771069 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:35.771817 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:35.772243 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:35.901936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:35.909493 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3ba19efe-75e7-425f-a2b0-95fd902cc873 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.151638 Jun 15 19:39:35.910429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 97/184] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:35 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:36.927722 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:36.928338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:36.935201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:36.935653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:36.936403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:36.936835 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:37.063312 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:37.072278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b24a59b5-87d8-441c-ace1-354c4f9e911b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.149503 Jun 15 19:39:37.072844 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 88/185] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:36 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:37.932768 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:37.933313 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:37.939481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:37.939919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:37.940689 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:37.941107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:37.963960 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-90d1ccb0-6ed7-4c15-890d-6d6d34e9b07a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/ips" status: 200 len: 146 microversion: 2.1 time: 0.035556 Jun 15 19:39:37.964523 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 98/186] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:39:37 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:39:38.088745 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:38.089375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:38.095954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:38.096406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:38.097177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:38.097608 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:38.228663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:38.236117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-89795b9d-ca27-402e-abda-971332ee89bb tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.151353 Jun 15 19:39:38.236673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 89/187] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:38 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:39.254524 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:39.255172 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:39.264310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:39.264310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:39.264310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:39.264310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:39.395797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:39.404143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cd57d850-ca3d-40eb-89ef-aa96df55a6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.153368 Jun 15 19:39:39.404687 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 99/188] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:39 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:40.045796 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:40.046318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:40.052902 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:40.053343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:40.054120 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:40.054549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:40.076765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-356d0829-385c-4af3-a07c-a4b5acdeae12 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/ips" status: 200 len: 149 microversion: 2.1 time: 0.034844 Jun 15 19:39:40.077327 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 90/189] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:39:40 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:39:40.422340 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:40.422951 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:40.429050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:40.429491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:40.430958 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:40.431289 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:40.565297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:40.573934 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-08a3208e-65d7-451a-b5b7-ec6c407f5d96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.156125 Jun 15 19:39:40.578330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 100/190] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:40 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:41.590649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:41.591259 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:41.597653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:41.598133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:41.598894 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:41.599325 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:41.601864 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=89 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:41.731331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:41.739079 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6b1836f4-24d3-4122-94c7-a16320fbaf6e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.152247 Jun 15 19:39:41.739633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 91/191] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:41 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:42.479154 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb484def-84ae-4a02-ba9c-db20131036be"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:42.480208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:42.486322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:42.486782 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:42.487521 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:42.487949 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:42.760095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:42.760733 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:42.767884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:42.768404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:42.769234 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:42.769750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:42.813925 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-229aeaa2-e2ba-4f6b-8c8e-3a70d0573b35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338530 Jun 15 19:39:42.819218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 101/192] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:39:42 2022] POST /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:39:42.966035 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:42.973984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d5fcbc24-8bc7-4ae0-8f28-2e66d795f1b2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.221279 Jun 15 19:39:42.984875 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 92/193] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:42 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:43.757511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d59aa27-3da9-450e-aeeb-a9f3e43f49df"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:43.758748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:43.765108 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:43.765555 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:43.766340 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:43.766771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:43.984581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:43.993507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:43.994262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:44.003615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:44.004337 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:44.005183 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:44.005694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:44.006954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-09487a8e-271b-46c4-a4c9-dc1c651d21f5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253389 Jun 15 19:39:44.013770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 102/194] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:39:43 2022] POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:39:44.183167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:44.191066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-271b838f-9ad7-4e56-8db6-2bf1e2b4a9f1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.202929 Jun 15 19:39:44.191639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 93/195] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:43 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:45.209620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:45.210289 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:45.220358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:45.220977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:45.221913 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:45.222376 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:45.377212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:45.385993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-057c9855-4111-422b-a2bf-6eefec99a131 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.180902 Jun 15 19:39:45.386477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 103/196] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:45 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:46.404885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:46.406674 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:46.417022 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:46.417944 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:46.418973 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:46.419787 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:46.557798 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:46.565486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-20d14d02-5629-4cdc-99d4-510d7b13c945 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.167642 Jun 15 19:39:46.566064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 94/197] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:46 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:47.583251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:47.584415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:47.590917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:47.591254 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:47.592139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:47.592555 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:47.932215 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:47.941742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-da7a2525-83fd-4b9a-86cc-cc8db5799b3d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.362707 Jun 15 19:39:47.942345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 104/198] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:47 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:48.960942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:48.962191 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:48.965414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=32 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:39:48.972827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:48.973871 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:48.974796 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:48.975233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:49.175382 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:49.185279 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2c088511-64e4-43ab-bcfb-635d6dfeda5b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.229316 Jun 15 19:39:49.191543 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 95/199] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:48 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:50.208657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:50.209266 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:50.216478 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:50.216927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:50.222021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:50.222021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:50.372792 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:50.388496 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-2d005175-4842-47cb-8d3b-081f7a75fee9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.176529 Jun 15 19:39:50.388496 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 105/200] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:50 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:50.397414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5428c321-bc3b-42ee-bfe8-b8d3a07b56c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: .version_select at 0x7f1645c63dc0>, body: {"keypair": {"name": "tempest-keypair-945975737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIX+geVs90ZTkisx6msgVH5MVUkQOiZUj1dc1XlDdomZuQepMU4mkpQPDdSimF/UOh6eJc5+yQMziob0IXrZoInWDxvWJHZTn9ZaGv8CPVM0N771qhqiXPdH6G/lRGfzw=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:50.413054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-5428c321-bc3b-42ee-bfe8-b8d3a07b56c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:39:50.417738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-5428c321-bc3b-42ee-bfe8-b8d3a07b56c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:39:50.447754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5428c321-bc3b-42ee-bfe8-b8d3a07b56c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053891 Jun 15 19:39:50.453683 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 96/201] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:39:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:39:51.402634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:51.403835 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:51.413309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:51.413309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:51.413309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:51.413994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:51.838741 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:51.846829 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3241079f-5f15-4dfe-9f1e-9c657579c20d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.451201 Jun 15 19:39:51.847726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 106/202] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:51 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:51.960028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-962661198", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ed2ffb-2899-41f6-afeb-0cd1a1d94e79"}], "security_groups": [{"name": "tempest-securitygroup--245291446"}], "key_name": "tempest-keypair-945975737", "user_data": "}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:52.093219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] validate_networks() for [('25ed2ffb-2899-41f6-afeb-0cd1a1d94e79', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:39:52.487456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:39:52.487878 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:39:52.488348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:39:52.488752 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:39:52.489160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:39:52.498602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:52.499293 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:52.500104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:52.500588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:52.517086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:39:52.521231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:39:52.532697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:39:52.535013 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:39:52.586550 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-75217d04-287f-49b1-bb17-15e3d9abf20b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630597 Jun 15 19:39:52.587370 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 97/203] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:39:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:39:52.597222 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-66661350-6b34-4871-b73d-c795d75ea4c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:52.597847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-66661350-6b34-4871-b73d-c795d75ea4c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:52.665355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-66661350-6b34-4871-b73d-c795d75ea4c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:52.672405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-66661350-6b34-4871-b73d-c795d75ea4c8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1240 microversion: 2.1 time: 0.078976 Jun 15 19:39:52.672967 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 107/204] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:52 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:52.865151 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:52.865929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:52.873319 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:52.873761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:52.874806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:52.875236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:53.009328 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:53.017211 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6c2d1640-e157-4a06-bab4-0d4f0b6bed3f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.156345 Jun 15 19:39:53.024548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 98/205] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:52 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:53.689816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:53.690472 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:53.697976 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:53.698438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:53.699190 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:53.699612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:53.763527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:53.771024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a255e120-cbdb-4577-8cf5-6f425f854e0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1292 microversion: 2.1 time: 0.084979 Jun 15 19:39:53.771585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 108/206] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:53 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:54.036773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:54.037309 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:54.045329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.045771 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.046567 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.046995 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.192873 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:54.203281 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8b50e582-b395-4e37-b46d-4b5545bb8bb2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1501 microversion: 2.1 time: 0.171726 Jun 15 19:39:54.204181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 99/207] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:54 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:54.221951 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbee8ee6-39b8-4711-ae79-0b8f32542c87"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:54.223251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:54.229730 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.230214 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.230985 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.231417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.255135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] HTTP exception thrown: Cannot 'attach_volume' instance 831dd3a2-1d82-45da-a99f-000c5954e54b while it is in vm_state rescued Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Request method failure captured: Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/os-volume_attachments HTTP/1.1 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 74 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUbZ4qQjAiJYFrc8uCgnNNVTiUog9NrJ2Az8mjSYdHbZAr7Tmr4xQ3AtjSj3bma_7bsijzbaQazE9MmzaBOOmRXK8fi_RBQR_x9fyIgr_tq7YYj-IQ-JkoCC1eLyxHZifmpPwUL-ssx5ZgL1u4p31qBuGBMNqRFmexF6-sIYC732O8 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:39:54.256805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d5270cd64fd4929af7b063cf2e2b653", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d5270cd64fd4929af7b063cf2e2b653"}]}] Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f26a832b69564f2a8387215afba6730e Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {"volumeAttachment": {"volumeId": "fbee8ee6-39b8-4711-ae79-0b8f32542c87"}} Jun 15 19:39:54.258937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Cannot 'attach_volume' instance 831dd3a2-1d82-45da-a99f-000c5954e54b while it is in vm_state rescued Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'server_id': '831dd3a2-1d82-45da-a99f-000c5954e54b', 'body': {'volumeAttachment': {'volumeId': 'fbee8ee6-39b8-4711-ae79-0b8f32542c87'}}} Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:39:54.259862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 831dd3a2-1d82-45da-a99f-000c5954e54b while it is in vm_state rescued Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:39:54.261260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 831dd3a2-1d82-45da-a99f-000c5954e54b while it is in vm_state rescued Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Returning 409 to user: Cannot 'attach_volume' instance 831dd3a2-1d82-45da-a99f-000c5954e54b while it is in vm_state rescued {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-717ad612-f1fa-47fa-8bc3-64e0a1021948 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041196 Jun 15 19:39:54.262713 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 109/208] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:39:54 2022] POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 19:39:54.267686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:54.268212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:54.274179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.274617 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.275364 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.275788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.344957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-24de6469-5623-4354-92b4-47fb349b87f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/action" status: 202 len: 0 microversion: 2.1 time: 0.080455 Jun 15 19:39:54.345511 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 100/209] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:39:54 2022] POST /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:39:54.354236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:54.355319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:54.363044 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.363580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.364676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.365437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.513198 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:54.526839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-49699d7c-2206-49ca-aa50-3e3fdce7c670 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1509 microversion: 2.1 time: 0.176651 Jun 15 19:39:54.527693 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 110/210] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:54 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:54.789746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:54.790474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:54.796679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.797130 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.797970 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:54.798351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:54.865827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:54.873750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6db86ff1-3923-493e-b8d7-9688fecf0e20 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1298 microversion: 2.1 time: 0.088786 Jun 15 19:39:54.874858 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 101/211] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:54 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:55.548992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:55.550169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:55.557381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:55.557908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:55.558785 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:55.559284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:55.714726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:55.722366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a34af23e-bdc5-4671-8ea2-1687ff0ba084 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1509 microversion: 2.1 time: 0.179905 Jun 15 19:39:55.722936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 111/212] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:55 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:39:55.891533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:55.892786 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:55.901563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:55.902292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:55.903293 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:55.903810 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:56.079386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:56.087669 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4e8184cc-5beb-4d85-82c9-6cfb8b97b9db tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.200606 Jun 15 19:39:56.088558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 102/213] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:55 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:56.193252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-6e067c30-6ebe-45b8-9447-adf2715cf5df req-d62324d9-6805-42dc-9fe2-7af8a4490494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7c26a-2656-4871-bc8c-fff9ca495889", "tag": "38c5a7a2-3e50-419d-842c-89b9faf77314"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:56.207180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-6e067c30-6ebe-45b8-9447-adf2715cf5df req-d62324d9-6805-42dc-9fe2-7af8a4490494 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:56.207662 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-6e067c30-6ebe-45b8-9447-adf2715cf5df req-d62324d9-6805-42dc-9fe2-7af8a4490494 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:56.220761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-6e067c30-6ebe-45b8-9447-adf2715cf5df req-d62324d9-6805-42dc-9fe2-7af8a4490494 service nova] Creating event network-changed:38c5a7a2-3e50-419d-842c-89b9faf77314 for instance 26e7c26a-2656-4871-bc8c-fff9ca495889 on hv-cinder-84456 Jun 15 19:39:56.225895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-6e067c30-6ebe-45b8-9447-adf2715cf5df req-d62324d9-6805-42dc-9fe2-7af8a4490494 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038176 Jun 15 19:39:56.226642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 112/214] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:39:56.739862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:56.740456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:56.746361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:56.747003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:56.747754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:56.748182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:56.895051 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:56.903961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e02aa3fd-954f-459e-8a36-d50e02d2b6b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1509 microversion: 2.1 time: 0.168232 Jun 15 19:39:56.904529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 103/215] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:56 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:56.924861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5ff81eee-b687-4640-b383-631034e4631c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:56.931784 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5ff81eee-b687-4640-b383-631034e4631c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:56.932299 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5ff81eee-b687-4640-b383-631034e4631c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:56.996144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5ff81eee-b687-4640-b383-631034e4631c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Going to try to stop instance {{(pid=129333) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 19:39:57.041912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5ff81eee-b687-4640-b383-631034e4631c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action" status: 202 len: 0 microversion: 2.1 time: 0.121579 Jun 15 19:39:57.042722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 113/216] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:39:56 2022] POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:39:57.050752 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:57.051355 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:57.057927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.058409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.059162 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.059760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.108548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:57.109020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:57.116411 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.117256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.118047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.118506 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.144476 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a96a04a3-d2fd-4e9b-a48c-68e28f5bc51f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/ips" status: 200 len: 151 microversion: 2.20 time: 0.045533 Jun 15 19:39:57.145267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 114/217] 10.222.0.15 () {60 vars in 1288 bytes} [Wed Jun 15 19:39:57 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:39:57.156270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:57.157187 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:57.165457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.165911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.166792 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.167233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.222519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:57.231860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4738d26a-22f1-4189-8d9b-8e3f33e283f1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.184797 Jun 15 19:39:57.233001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 104/218] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:57 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:57.326466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:57.333976 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ae8ae23d-535c-4c82-a719-0e76d97cc488 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.187544 Jun 15 19:39:57.344596 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 115/219] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:57 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:57.925950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:57.926712 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:57.934132 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.934833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:57.935701 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:57.936229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:58.141025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:58.149029 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0bb98c30-8435-4ad6-a363-e154f42c1d8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1509 microversion: 2.1 time: 0.226884 Jun 15 19:39:58.149593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 105/220] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:57 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:58.250574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:58.251165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:58.257887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:58.258366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:58.259137 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:58.259569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:58.351976 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:58.352881 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:58.360618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:58.361280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:58.362498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:58.363075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:58.447244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:58.455543 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-71e9370c-20fb-44ee-8559-edc35493a83b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.209269 Jun 15 19:39:58.456603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 116/221] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:58 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:58.544068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:58.552137 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b560b073-fd2c-40ef-a28d-dfb1bd59762c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.204463 Jun 15 19:39:58.552712 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 106/222] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:58 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:39:59.166407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:59.167021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:59.173901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:59.174484 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:59.175252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:59.175684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:59.308854 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:59.316554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f2bd4d36-b06f-4c09-8fad-ae3cefdb18c3 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1509 microversion: 2.1 time: 0.154061 Jun 15 19:39:59.317113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 117/223] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:59 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:59.472773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:59.473304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:59.479857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:59.480304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:59.481080 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:59.481513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:59.568716 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:39:59.569571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:39:59.577827 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:59.579157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:59.580415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:39:59.581304 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:39:59.614870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:59.623517 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7672ccf9-f30b-464b-a5dd-5a7213c22cc0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.154670 Jun 15 19:39:59.624356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 107/224] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:59 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:39:59.743294 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:39:59.751840 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-857a4b68-e713-409e-8e07-4f3a35ed6a39 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.186981 Jun 15 19:39:59.752432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 118/225] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:39:59 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:39:59.907065 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-571553693", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "networks": [{"uuid": "c7953e1c-32f1-43bd-a8e2-687b003d29d3"}]}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:39:59.957219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] validate_networks() for [('c7953e1c-32f1-43bd-a8e2-687b003d29d3', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:40:00.198216 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:00.198794 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:00.205600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.206052 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.206874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.207309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.232423 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lazy-loading 'flavor' on Instance uuid eadf922d-e2cd-4805-9aee-7157bd242fa9 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:40:00.290900 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:00.349526 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:40:00.350313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:40:00.351105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:40:00.351615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:40:00.352123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:40:00.361633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.362185 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.363229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.364114 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.385741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Getting quotas for project 526f86dc251440b9b50e325de4efb751. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:40:00.389899 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Getting quotas for user d6619b929f1844f48e0aa452ff5b8b51 and project 526f86dc251440b9b50e325de4efb751. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:40:00.403778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:40:00.406056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:40:00.454548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-eb16fdb7-9012-4fe8-91e2-51e4eb438c6a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551286 Jun 15 19:40:00.458225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 108/226] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:40:00.463341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:00.464117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:00.471017 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.471627 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.472902 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.474018 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.479641 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:00.612224 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-45996470-5477-476a-99b0-5f962a7f604f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/action" status: 202 len: 0 microversion: 2.20 time: 0.417834 Jun 15 19:40:00.613406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 119/227] 10.222.0.15 () {62 vars in 1318 bytes} [Wed Jun 15 19:40:00 2022] POST /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:40:00.619120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a26bb16c-6bf4-43dd-864b-1fd4c081944e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:00.620199 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a26bb16c-6bf4-43dd-864b-1fd4c081944e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:00.724345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a26bb16c-6bf4-43dd-864b-1fd4c081944e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:00.728415 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:00.731627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a26bb16c-6bf4-43dd-864b-1fd4c081944e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1218 microversion: 2.1 time: 0.116872 Jun 15 19:40:00.732368 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 120/228] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:00 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:00.737681 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c543e464-a879-49cb-80e3-aa9950b13c1f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1515 microversion: 2.1 time: 0.278256 Jun 15 19:40:00.738278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 109/229] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:00 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:00.745689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:00.746586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:00.755763 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:00.756615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:00.764236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.764576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.765070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.765349 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.765875 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.766965 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:00.767776 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:00.769331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:01.085262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:01.099217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9bc55b57-7033-402f-bc7f-7e48470ad0db tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.359687 Jun 15 19:40:01.099806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 110/230] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:00 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:01.107335 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:01.112064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:01.123613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:01.126979 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:01.128044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:01.130441 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:01.164594 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:01.179486 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:01.183849 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:01.185041 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-834a606d-7475-4257-9258-ab407d73d02a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.444323 Jun 15 19:40:01.185604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 121/231] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:00 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:01.322962 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:01.330494 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4dde2058-10b5-43b4-9264-ac52fa9f3357 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.229336 Jun 15 19:40:01.331461 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 111/232] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:01 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:01.748735 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:01.749604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:01.756125 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:01.756571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:01.757990 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:01.758455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:01.819192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:01.827144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c33fc783-b328-4270-acfc-74355bbfb158 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1214 microversion: 2.1 time: 0.082336 Jun 15 19:40:01.827699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 122/233] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:01 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:02.116147 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:02.117304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:02.124219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.124830 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.125657 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.126134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.213878 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:02.214822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:02.221685 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.222889 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.223971 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.225060 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.257471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:02.265488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d4968a9c-9cdb-40a9-abb0-8115e0b2dcde tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.153109 Jun 15 19:40:02.266030 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 112/234] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:02 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:02.274347 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d8758cf0-6c3f-45fb-8a96-9df194d287ea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'create', calling method: .version_select at 0x7f1645a6c790>, body: {"keypair": {"name": "tempest-keypair-596616471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk6Upoiz3JuEmmhHKljyiKzzYy0MhLqKu5LCEmgUVoNN0P1o+cYLE8YkP967nvy/hlc49u0SvN8a/hRvzEolWWK9kKKMd5rMfavsomEsjLidnDogd7yEMFEu6+9COStbQ=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:02.285985 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-d8758cf0-6c3f-45fb-8a96-9df194d287ea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:40:02.290464 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-d8758cf0-6c3f-45fb-8a96-9df194d287ea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for user f26a832b69564f2a8387215afba6730e and project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:40:02.313728 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d8758cf0-6c3f-45fb-8a96-9df194d287ea tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046611 Jun 15 19:40:02.318488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 113/235] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:40:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:02.353893 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:02.354788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:02.365604 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.366403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.367743 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.368177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.373444 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:02.382006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:02.384107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:02.385296 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-43805547-d091-472e-81b6-6859c62137d2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.175248 Jun 15 19:40:02.386397 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 123/236] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:02 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:02.552056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:02.560300 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4c200e9d-f217-40b0-836e-0c584323a826 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.214097 Jun 15 19:40:02.560866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 114/237] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:02 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:40:02.848179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:02.849375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:02.856023 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.856466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.857522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:02.859872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:02.942655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:02.953753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a04f788e-37eb-47dc-8ea9-087a9e5c84cd tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1270 microversion: 2.1 time: 0.110250 Jun 15 19:40:02.954521 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 124/238] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:02 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:03.285365 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:03.286665 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:03.297832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.301371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.302595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.303557 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.409620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:03.410859 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:03.419420 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.419973 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.421529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.422177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.787477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:03.797197 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-991c18f6-25fe-4528-9e41-bbb5a2bcf4fa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.516397 Jun 15 19:40:03.805883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 115/239] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:03 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:03.811512 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:03.812310 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:03.820224 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.820674 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.821475 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.821914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.908618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:03.918931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:03.920438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:03.921608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-332c4de5-9b45-4405-b4b9-0c374342ffac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.521216 Jun 15 19:40:03.922791 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 125/240] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:03 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:03.970499 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:03.971115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:03.977697 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.978403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:03.979146 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:03.979556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:04.091617 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:04.100375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-af5fad5f-a628-420e-b92d-10d05e197101 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.293005 Jun 15 19:40:04.101072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 116/241] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:03 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:04.247418 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:04.256452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-443a442a-b6da-4541-92aa-dbdbdbb3bd5a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1318 microversion: 2.1 time: 0.289678 Jun 15 19:40:04.257069 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 126/242] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:03 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:40:04.268207 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-89bccf29-4b95-4e2a-9ff5-3ad562cf30c3 req-58ca8633-62cf-4997-8472-75dfb4aca13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5", "tag": "b219c8bb-f080-4767-a6ee-30df4ef8dfec"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:04.283111 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-89bccf29-4b95-4e2a-9ff5-3ad562cf30c3 req-58ca8633-62cf-4997-8472-75dfb4aca13f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:04.283548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-89bccf29-4b95-4e2a-9ff5-3ad562cf30c3 req-58ca8633-62cf-4997-8472-75dfb4aca13f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:04.298301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-89bccf29-4b95-4e2a-9ff5-3ad562cf30c3 req-58ca8633-62cf-4997-8472-75dfb4aca13f service nova] Creating event network-changed:b219c8bb-f080-4767-a6ee-30df4ef8dfec for instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 on hv-cinder-84456 Jun 15 19:40:04.303684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-89bccf29-4b95-4e2a-9ff5-3ad562cf30c3 req-58ca8633-62cf-4997-8472-75dfb4aca13f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045374 Jun 15 19:40:04.305139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 117/243] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:04.373765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-97318519", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f41991f1-753c-4841-8d77-8c975a43b0cd"}], "security_groups": [{"name": "tempest-securitygroup--327546948"}], "key_name": "tempest-keypair-596616471", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:04.491013 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] validate_networks() for [('f41991f1-753c-4841-8d77-8c975a43b0cd', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:40:04.816870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:04.817562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:04.830591 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:04.831045 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:04.831829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:04.832268 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.020842 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:40:05.021254 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:40:05.021765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:40:05.022233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:40:05.022651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:40:05.032739 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.033194 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.034029 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.034500 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.051959 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:40:05.059690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Getting quotas for user f26a832b69564f2a8387215afba6730e and project 0d5270cd64fd4929af7b063cf2e2b653. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:40:05.069414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.071446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:40:05.073840 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:40:05.078841 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3d1a3ef9-5627-471c-a6bc-b25d2fc960c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.267383 Jun 15 19:40:05.079650 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 118/244] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:04 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:40:05.085120 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-16301e3a-a214-41f3-9d40-0754dd4a0fbf req-81233b41-19f3-4a76-9c48-b2ca7b08851c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7c26a-2656-4871-bc8c-fff9ca495889", "name": "network-vif-plugged", "status": "completed", "tag": "38c5a7a2-3e50-419d-842c-89b9faf77314"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:05.093908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-16301e3a-a214-41f3-9d40-0754dd4a0fbf req-81233b41-19f3-4a76-9c48-b2ca7b08851c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.094560 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-16301e3a-a214-41f3-9d40-0754dd4a0fbf req-81233b41-19f3-4a76-9c48-b2ca7b08851c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.107415 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-16301e3a-a214-41f3-9d40-0754dd4a0fbf req-81233b41-19f3-4a76-9c48-b2ca7b08851c service nova] Creating event network-vif-plugged:38c5a7a2-3e50-419d-842c-89b9faf77314 for instance 26e7c26a-2656-4871-bc8c-fff9ca495889 on hv-cinder-84456 Jun 15 19:40:05.113624 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-16301e3a-a214-41f3-9d40-0754dd4a0fbf req-81233b41-19f3-4a76-9c48-b2ca7b08851c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032499 Jun 15 19:40:05.114236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 119/245] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:05.123422 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-68a2622b-6291-4dfc-90ac-5799d7d9387f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.754518 Jun 15 19:40:05.124407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 127/246] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:40:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 19:40:05.124842 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:05.125817 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:05.128032 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:05.129065 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:05.129780 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:05.138276 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.138554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.138855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.139554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.139757 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.140285 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.140499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.141462 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.365416 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.372717 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.376523 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9c47faef-d56d-4b97-99d7-9529f30bc5a5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.250790 Jun 15 19:40:05.376964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 128/247] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:05 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:05.381879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-44f20921-619a-4666-a332-b0950970792e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:05.383136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-44f20921-619a-4666-a332-b0950970792e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:05.386774 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.388480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.389762 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b2e76f2c-60bd-44b2-88b2-cfaa699c7e2f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.274247 Jun 15 19:40:05.390463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 120/248] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:05 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:05.394991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:05.395657 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:05.402408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.402835 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.403943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:05.404545 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:05.437239 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-44f20921-619a-4666-a332-b0950970792e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.444589 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-44f20921-619a-4666-a332-b0950970792e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1243 microversion: 2.1 time: 0.066590 Jun 15 19:40:05.445795 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 129/249] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:05 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1243 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:05.547947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:05.556278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a27a7542-bbdb-412f-a50c-d238fbb297d9 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1318 microversion: 2.1 time: 0.164706 Jun 15 19:40:05.556855 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 121/250] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:05 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:06.096724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:06.097335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:06.099804 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:06.107459 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.108118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.109670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.110641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.283894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.293085 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-04bff7cf-9234-4954-83fd-27567411fd63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.200023 Jun 15 19:40:06.293718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 130/251] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:06 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:06.395057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:06.395850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:06.404813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.405517 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.406435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.406974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.408978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:06.409897 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:06.416342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.417099 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.418027 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.418690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.621264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.629447 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-36b0f668-c923-4014-a734-113e591cb99b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.239871 Jun 15 19:40:06.635430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 122/252] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:06 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:06.635693 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.635971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:06.636642 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:06.642559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.642736 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.643187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.643949 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.644066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.644386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.645195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-78fd6304-eb11-4f0f-9909-fd08e01e2b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.240400 Jun 15 19:40:06.645754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 131/253] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:06 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:06.650895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:06.651593 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:06.658075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.658561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.659338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:06.659771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:06.720923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.728886 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c1af0e5c-302e-4065-a07e-f36c1064adc9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1295 microversion: 2.1 time: 0.097444 Jun 15 19:40:06.730338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 123/254] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:06 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:06.823355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:06.830762 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7f61a96d-7ad0-41b7-b5ba-7db8dd2b83cf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1318 microversion: 2.1 time: 0.183918 Jun 15 19:40:06.831330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 132/255] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:06 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:07.310796 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:07.311437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:07.317385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.317864 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.318759 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.319404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.482682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:07.490564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fb442363-a7fa-42aa-8a8e-8d16673f55d7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.183589 Jun 15 19:40:07.491135 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 124/256] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:07 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:07.646866 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:07.647472 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:07.656359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.656812 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.657610 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.658044 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.664869 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:07.666120 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:07.672928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.673465 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.674342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.674856 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.871754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:07.878020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:07.881648 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:07.883915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:07.885374 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f98d1d83-641b-4de7-88ef-1f009ec784a1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.225124 Jun 15 19:40:07.885943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 125/257] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:07 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:40:07.890826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:07.891430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:07.897073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a48c009c-2f44-48c4-9b1d-1255dedef9a1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1365 microversion: 2.1 time: 0.254029 Jun 15 19:40:07.900849 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.901291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.902045 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.902497 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.903110 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 133/258] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:07 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:07.908090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:07.908825 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:07.917085 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.917676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.918697 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:07.919235 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:07.975546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:07.989116 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-38a0deb9-8e9e-40f4-b944-28311b1183f6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1301 microversion: 2.1 time: 0.101410 Jun 15 19:40:07.989807 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 126/259] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:07 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:08.095118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:08.102771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1944c5a9-128e-4d26-8bf2-e8c2f0bf1ef8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1318 microversion: 2.1 time: 0.198320 Jun 15 19:40:08.103282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 134/260] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:07 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:08.509616 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:08.510247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:08.516614 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.517055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:08.517809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.518265 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:08.671883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:08.681024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-48dcd556-b24e-4901-98ff-968cc89aaf6e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.175709 Jun 15 19:40:08.681707 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 127/261] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:08 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:08.870993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-8e8cb98f-6a54-4bf2-b484-3a984844eea1 req-d0751517-145e-472d-b5b0-deaa83fcadb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5", "name": "network-vif-plugged", "status": "completed", "tag": "b219c8bb-f080-4767-a6ee-30df4ef8dfec"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:08.880828 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-8e8cb98f-6a54-4bf2-b484-3a984844eea1 req-d0751517-145e-472d-b5b0-deaa83fcadb8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.881325 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-8e8cb98f-6a54-4bf2-b484-3a984844eea1 req-d0751517-145e-472d-b5b0-deaa83fcadb8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:08.894589 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-8e8cb98f-6a54-4bf2-b484-3a984844eea1 req-d0751517-145e-472d-b5b0-deaa83fcadb8 service nova] Creating event network-vif-plugged:b219c8bb-f080-4767-a6ee-30df4ef8dfec for instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 on hv-cinder-84456 Jun 15 19:40:08.900997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-8e8cb98f-6a54-4bf2-b484-3a984844eea1 req-d0751517-145e-472d-b5b0-deaa83fcadb8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034237 Jun 15 19:40:08.902574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 135/262] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:08.906645 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:08.907489 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:08.927779 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.929474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:08.930477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.931080 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:08.938889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=100 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:08.948366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:08.949094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:08.962551 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.963384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:08.964314 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:08.964960 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.224355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.240557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4adac926-84e9-4d9a-8839-e4ca4bec80b3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1555 microversion: 2.1 time: 0.322997 Jun 15 19:40:09.241821 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 136/263] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:08 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1555 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:09.246610 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:09.247286 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:09.257417 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.267547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.267936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.269138 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.269944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.271190 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.272188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.273227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e1111b2a-7cfb-44c1-ad18-d554655d951d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.371644 Jun 15 19:40:09.274699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 128/264] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:08 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:09.280481 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:09.281360 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:09.298596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.299146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.300604 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.301460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.511744 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.513543 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.522412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8352abc3-df96-4ef3-a8ff-99bae4dabdc4 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1318 microversion: 2.1 time: 0.246469 Jun 15 19:40:09.523581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 129/265] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:09 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:09.532217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d53d7724-ded5-4ad0-83dd-992bf4ef3b86 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.281107 Jun 15 19:40:09.532217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 137/266] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:09 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:09.532441 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:09.532441 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:09.538588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.539154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.540039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.540588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.546036 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-897872da-ad34-4237-b793-380f790a9205 req-719a98ee-18c1-4ba8-93a3-27e4f05190b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4eda938-2478-4ddd-9f99-974f3ffe7123", "tag": "a87c9c4f-dbec-4c55-a398-b538509f41ea"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:09.554962 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-897872da-ad34-4237-b793-380f790a9205 req-719a98ee-18c1-4ba8-93a3-27e4f05190b1 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.555552 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-897872da-ad34-4237-b793-380f790a9205 req-719a98ee-18c1-4ba8-93a3-27e4f05190b1 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.568075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-897872da-ad34-4237-b793-380f790a9205 req-719a98ee-18c1-4ba8-93a3-27e4f05190b1 service nova] Creating event network-changed:a87c9c4f-dbec-4c55-a398-b538509f41ea for instance f4eda938-2478-4ddd-9f99-974f3ffe7123 on hv-cinder-84456 Jun 15 19:40:09.574495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-897872da-ad34-4237-b793-380f790a9205 req-719a98ee-18c1-4ba8-93a3-27e4f05190b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045862 Jun 15 19:40:09.575230 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 138/267] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:09.625270 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-58dbacb2-8c81-478a-8d18-c22cd915820f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100569 Jun 15 19:40:09.625858 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 130/268] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:40:09 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:09.698789 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:09.699492 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:09.705963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.706453 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.707229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:09.707669 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:09.712181 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:09.847274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:09.858098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-16fc742b-5b12-4126-af0e-c2c4397363a3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.161324 Jun 15 19:40:09.858098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 139/269] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:09 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:10.292376 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:10.292976 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:10.299331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.299769 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.300530 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.300955 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.375073 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=4 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:10.439936 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:10.448952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:10.450506 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:10.451692 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-962b1e57-5e14-4b80-8563-d366986af1ce tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.163795 Jun 15 19:40:10.452260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 131/270] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:10 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:10.541121 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:10.541860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:10.549175 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.550048 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.550412 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.550903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.562069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:10.562730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:10.569522 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.569973 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.570784 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.571386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.764218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:10.770446 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:10.778705 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4791c451-b962-4a3e-8561-016376028f20 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.232028 Jun 15 19:40:10.779557 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 132/271] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:10 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:10.781076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3227a9d8-f288-4777-9371-4df5cf5dbb03 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1318 microversion: 2.1 time: 0.244763 Jun 15 19:40:10.781743 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 140/272] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:10 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:10.873439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:10.874342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:10.880373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.880821 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:10.882724 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:10.882724 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.014390 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:11.022568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-02e28fa1-e713-4eee-b1e0-78c2615b6bca tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.153736 Jun 15 19:40:11.023745 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 133/273] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:10 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:11.471068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:11.471593 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:11.484593 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.485042 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.485813 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.486298 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.590234 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-febd2bf3-d41f-4d91-917a-0be17c510e82 req-a92f5d9c-e3a1-46a1-8651-b357d1ae4685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e7c26a-2656-4871-bc8c-fff9ca495889", "tag": "38c5a7a2-3e50-419d-842c-89b9faf77314"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:11.598789 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-febd2bf3-d41f-4d91-917a-0be17c510e82 req-a92f5d9c-e3a1-46a1-8651-b357d1ae4685 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.599229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-febd2bf3-d41f-4d91-917a-0be17c510e82 req-a92f5d9c-e3a1-46a1-8651-b357d1ae4685 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.615274 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-febd2bf3-d41f-4d91-917a-0be17c510e82 req-a92f5d9c-e3a1-46a1-8651-b357d1ae4685 service nova] Creating event network-changed:38c5a7a2-3e50-419d-842c-89b9faf77314 for instance 26e7c26a-2656-4871-bc8c-fff9ca495889 on hv-cinder-84456 Jun 15 19:40:11.621848 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-febd2bf3-d41f-4d91-917a-0be17c510e82 req-a92f5d9c-e3a1-46a1-8651-b357d1ae4685 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035216 Jun 15 19:40:11.623085 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 134/274] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:40:11.633905 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:11.642199 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:11.643781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:11.645058 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0992b091-ab2c-4b2c-ae5a-3a685c34b772 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.178992 Jun 15 19:40:11.646061 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 141/275] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:11 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:11.799378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:11.799816 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:11.800047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:11.800715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:11.807672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.808127 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.808340 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.808787 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.808904 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.809339 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:11.809582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:11.810031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:12.011250 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:12.015435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:12.018993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c5e3398b-24be-4815-9a06-14879a211d81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1506 microversion: 2.1 time: 0.223345 Jun 15 19:40:12.019570 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 135/276] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:11 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:12.024140 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-db822359-2120-44ee-9729-4e22162344e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.228663 Jun 15 19:40:12.033594 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 142/277] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:11 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:12.040245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:12.040847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:12.048631 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:12.049981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:12.051795 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:12.052307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:12.198954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:12.207005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ca11c9f7-15f1-459f-b7a7-b3d0fb9a8242 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.171027 Jun 15 19:40:12.207581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 136/278] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:12 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:12.663638 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:12.664447 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:12.671235 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:12.671681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:12.672451 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:12.672908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:12.806606 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:12.815090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:12.816618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:12.817795 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0a002781-ef4e-46fa-8ea3-6677db698a7d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1745 microversion: 2.20 time: 0.158281 Jun 15 19:40:12.818418 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 143/279] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:12 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:13.041252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:13.042444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:13.045752 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=20 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:13.050364 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:13.050900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:13.051732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:13.052286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:13.200025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:13.210426 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-60957141-2856-4480-87c7-fe5b869e3136 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.172941 Jun 15 19:40:13.210985 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 137/280] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:13 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:13.224519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:13.225124 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:13.231634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:13.232075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:13.232821 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:13.233245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:13.383482 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:13.391618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7bc09b0a-066b-437a-8285-a8b1e1e53cfb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.170854 Jun 15 19:40:13.392123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 144/281] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:13 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:13.837312 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:13.837950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:13.843965 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:13.844419 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:13.845331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:13.845872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:13.981944 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:13.990369 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:13.991874 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:13.993030 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6acd5abd-62e5-47bb-b563-edb7e9bfb3f0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1745 microversion: 2.20 time: 0.160164 Jun 15 19:40:13.993580 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 138/282] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:13 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:14.227399 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:14.227956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:14.235670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:14.236112 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:14.236887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:14.237311 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:14.377442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:14.385654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9ecbd6ba-d360-45e6-81b4-a226f0456400 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.162310 Jun 15 19:40:14.386538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 145/283] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:14 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:14.408317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:14.409004 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:14.416862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:14.417305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:14.418069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:14.418519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:14.558333 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:14.566371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-94d743f8-4bab-40bb-8fb0-2657e27107a7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1724 microversion: 2.1 time: 0.161702 Jun 15 19:40:14.567095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 139/284] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:14 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:15.011940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:15.012546 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:15.018639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.019080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.019833 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.020258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.041757 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:15.147728 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-ee544388-3257-4cc7-a32d-f7d608d25aff req-dfa2ad3f-66c5-4fd5-b962-454e57398244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "name": "network-vif-plugged", "status": "completed", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:15.156478 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-ee544388-3257-4cc7-a32d-f7d608d25aff req-dfa2ad3f-66c5-4fd5-b962-454e57398244 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.156977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-ee544388-3257-4cc7-a32d-f7d608d25aff req-dfa2ad3f-66c5-4fd5-b962-454e57398244 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.159115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:15.171474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-ee544388-3257-4cc7-a32d-f7d608d25aff req-dfa2ad3f-66c5-4fd5-b962-454e57398244 service nova] Creating event network-vif-plugged:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:40:15.171989 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:15.176112 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:15.176539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-ee544388-3257-4cc7-a32d-f7d608d25aff req-dfa2ad3f-66c5-4fd5-b962-454e57398244 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033814 Jun 15 19:40:15.177126 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 140/285] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:40:15.177756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1a311d75-3198-497f-b2b0-0ca83b6bddb8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1745 microversion: 2.20 time: 0.170031 Jun 15 19:40:15.178731 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 146/286] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:15 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:15.406257 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:15.407250 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:15.417679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.418439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.419645 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.420335 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.574889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:15.583292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:15.583873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:15.591449 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=12 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:15.597640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a5ce4859-ca8d-4f2d-94d3-774e21f91255 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.198552 Jun 15 19:40:15.598175 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 141/287] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:15 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:15.601847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.602319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.603273 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.604153 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.748418 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:15.757266 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-27ae29ef-cf9d-4976-b437-44f3ddc28f71 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1701 microversion: 2.1 time: 0.177083 Jun 15 19:40:15.757836 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 147/288] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:15 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:40:15.775106 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1b1d9496-2afe-4a39-9734-c36251215ea7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:15.781593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1b1d9496-2afe-4a39-9734-c36251215ea7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.782129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1b1d9496-2afe-4a39-9734-c36251215ea7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.848936 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1b1d9496-2afe-4a39-9734-c36251215ea7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Going to try to start instance {{(pid=129334) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 19:40:15.891924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1b1d9496-2afe-4a39-9734-c36251215ea7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action" status: 202 len: 0 microversion: 2.1 time: 0.121197 Jun 15 19:40:15.892533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 142/289] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:40:15 2022] POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:40:15.901311 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:15.902230 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:15.908283 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.908729 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:15.909492 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:15.909917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:16.055447 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:16.064210 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ed905947-9472-4994-8bbe-2ecf36779cdf tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1710 microversion: 2.1 time: 0.167220 Jun 15 19:40:16.064797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 148/290] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:15 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:16.197104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:16.197829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:16.204723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:16.205169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:16.205940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:16.206409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:16.340339 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:16.349449 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:16.351578 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:16.352738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2f883845-62c3-4746-9026-a344ff63808a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.159912 Jun 15 19:40:16.353307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 143/291] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:16 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:16.614858 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:16.615232 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:16.621853 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:16.622339 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:16.623101 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:16.623532 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:16.757847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:16.765656 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1241c89b-c3f2-4a3b-a90d-d21884a2882c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.154967 Jun 15 19:40:16.766352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 149/292] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:16 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:17.082032 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:17.082662 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:17.089816 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.090296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.091076 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.091501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.204944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-00d2cd76-c330-47b1-b754-77391bae8d46 req-8ede3c09-9a6d-4719-ba45-e1b2c5f0d493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eda938-2478-4ddd-9f99-974f3ffe7123", "name": "network-vif-plugged", "status": "completed", "tag": "a87c9c4f-dbec-4c55-a398-b538509f41ea"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:17.213763 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-00d2cd76-c330-47b1-b754-77391bae8d46 req-8ede3c09-9a6d-4719-ba45-e1b2c5f0d493 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.214157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-00d2cd76-c330-47b1-b754-77391bae8d46 req-8ede3c09-9a6d-4719-ba45-e1b2c5f0d493 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.223121 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:17.231015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-05e4135d-1158-48a9-aee2-efb27241f485 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1710 microversion: 2.1 time: 0.152823 Jun 15 19:40:17.231370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-00d2cd76-c330-47b1-b754-77391bae8d46 req-8ede3c09-9a6d-4719-ba45-e1b2c5f0d493 service nova] Creating event network-vif-plugged:a87c9c4f-dbec-4c55-a398-b538509f41ea for instance f4eda938-2478-4ddd-9f99-974f3ffe7123 on hv-cinder-84456 Jun 15 19:40:17.231574 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 144/293] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:17 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:17.236406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-00d2cd76-c330-47b1-b754-77391bae8d46 req-8ede3c09-9a6d-4719-ba45-e1b2c5f0d493 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035112 Jun 15 19:40:17.237071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 150/294] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:40:17.372103 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:17.372705 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:17.379020 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.379458 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.380209 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.380674 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.398400 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:17.525307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:17.533303 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:17.534836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:17.536013 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7ae460c7-4e7d-4f04-a511-42fc8b263ba1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.167775 Jun 15 19:40:17.536564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 145/295] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:17 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:17.783546 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:17.784242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:17.791487 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.791935 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.792696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:17.793126 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:17.941728 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:17.950279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5f1737b0-2c28-4da1-80a9-e4a841a360ce tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.170863 Jun 15 19:40:17.956011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 151/296] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:17 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:18.247480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:18.248076 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:18.254850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:18.255284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:18.256029 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:18.256468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:18.389618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:18.398005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fae5bed7-604c-473d-bc0f-6844e156e07b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1714 microversion: 2.1 time: 0.154352 Jun 15 19:40:18.398584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 146/297] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:18 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:18.554970 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:18.555503 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:18.561774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:18.562243 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:18.563007 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:18.563435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:18.698178 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:18.705994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:18.707573 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:18.708783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-335b0adb-e2e5-4c58-bf52-c8c164ebd9c3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.158437 Jun 15 19:40:18.709358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 152/298] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:18 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:18.973647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:18.974224 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:18.980478 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:18.980913 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:18.981664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:18.982104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:19.114629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:19.122649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-05f15f2e-1f0c-42e2-bd99-3fcce444eb78 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1368 microversion: 2.1 time: 0.153999 Jun 15 19:40:19.123199 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 147/299] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:18 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:19.727500 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:19.728123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:19.735038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:19.735612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:19.736569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:19.737133 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:19.886937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:19.897811 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:19.900319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:19.906212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-33134741-4fbd-4cad-8192-4bdb7dbf7bae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.182515 Jun 15 19:40:19.906876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 153/300] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:19 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:20.139678 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:20.140513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:20.147390 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:20.148139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:20.149206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:20.149648 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:20.305119 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:20.318189 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4eff065d-1851-44b4-ad58-adc01238f140 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1562 microversion: 2.1 time: 0.182262 Jun 15 19:40:20.318984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 148/301] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:40:20 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:40:20.342685 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:20.343570 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:20.356313 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:20.356641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:20.360968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:20.361616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:20.450205 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-05485920-d0f7-47bf-8a88-42c28096a71c tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111340 Jun 15 19:40:20.457725 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 154/302] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:40:20 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:20.930135 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:20.931177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:20.944690 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:20.945486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:20.946452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:20.947039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:21.304858 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:21.317809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:21.318242 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:21.320058 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1bc17bab-ca47-43ad-a586-0e39d85a4d44 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.394634 Jun 15 19:40:21.352055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 149/303] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:20 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:21.875405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-ce5e188e-699f-461f-b1b1-73e43f771174 req-8f31d116-fbd8-4519-94d6-337f81fd6577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4eda938-2478-4ddd-9f99-974f3ffe7123", "tag": "a87c9c4f-dbec-4c55-a398-b538509f41ea"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:21.887240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-ce5e188e-699f-461f-b1b1-73e43f771174 req-8f31d116-fbd8-4519-94d6-337f81fd6577 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:21.888002 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-ce5e188e-699f-461f-b1b1-73e43f771174 req-8f31d116-fbd8-4519-94d6-337f81fd6577 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:21.911023 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-ce5e188e-699f-461f-b1b1-73e43f771174 req-8f31d116-fbd8-4519-94d6-337f81fd6577 service nova] Creating event network-changed:a87c9c4f-dbec-4c55-a398-b538509f41ea for instance f4eda938-2478-4ddd-9f99-974f3ffe7123 on hv-cinder-84456 Jun 15 19:40:21.918374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-ce5e188e-699f-461f-b1b1-73e43f771174 req-8f31d116-fbd8-4519-94d6-337f81fd6577 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047549 Jun 15 19:40:21.923701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 155/304] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:22.346986 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:22.347603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:22.354867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:22.355765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:22.356552 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:22.357155 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:22.592934 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:22.601887 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:22.605187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:22.608318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7cd57dd3-d2b6-4307-b184-0e0d5f2342ee tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.271055 Jun 15 19:40:22.609641 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 150/305] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:22 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:23.629533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:23.630262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:23.639885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:23.640622 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:23.641408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:23.641837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:23.792573 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:23.804161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:23.806256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:23.808158 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-596e4567-f13f-46c3-9e60-25d3ea20cb31 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.183045 Jun 15 19:40:23.809163 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 156/306] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:23 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:24.827228 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:24.828625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:24.835673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:24.836225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:24.837069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:24.837569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:24.989611 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:25.002760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:25.004272 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:25.005460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2787355a-3f0d-4192-a9f5-c4367bd5bd33 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.182108 Jun 15 19:40:25.006964 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 151/307] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:24 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:26.039452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:26.040184 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:26.053274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:26.053845 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:26.054728 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:26.055231 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:26.078493 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=100 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:26.233722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:26.252180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:26.255603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:26.257829 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d7280026-ddd0-4003-ba81-fcd372005363 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.233285 Jun 15 19:40:26.265162 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 157/308] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:26 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:27.279251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:27.280507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:27.289900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:27.291600 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:27.293209 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:27.293867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:27.454917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:27.469821 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:27.471580 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:27.473055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-88811289-1537-4b76-ad88-1f2a5b375e11 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.197684 Jun 15 19:40:27.484350 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 152/309] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:27 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:40:28.491666 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:28.492418 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:28.499968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:28.500427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:28.501271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:28.501710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:28.670070 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:28.680746 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:28.682313 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:28.683467 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-987ed816-68b3-4a8b-b67e-e01c1e0399e2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.196390 Jun 15 19:40:28.684009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 158/310] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:28 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:29.702118 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:29.702690 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:29.709026 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:29.709466 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:29.710256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:29.710672 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:29.837730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:29.845561 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:29.847082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:29.848240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-984dbafb-dedf-46ee-9bf0-011b9487545c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1740 microversion: 2.20 time: 0.150273 Jun 15 19:40:29.848775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 153/311] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:29 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:30.867447 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:30.868047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:30.875070 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:30.875514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:30.876262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:30.876688 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:31.006852 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:31.014692 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:31.016188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:31.017357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-86a59205-480f-46d3-9269-6c0f6f74b84f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1722 microversion: 2.20 time: 0.154300 Jun 15 19:40:31.017907 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 159/312] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:30 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:32.035798 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:32.036402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:32.042439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:32.042883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:32.043639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:32.044072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:32.170459 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:32.178332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:32.179841 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:32.181004 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2bfa6e81-4d2b-40ac-95cc-21c19a4e56c6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1722 microversion: 2.20 time: 0.149271 Jun 15 19:40:32.181540 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 154/313] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:32 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:32.905346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-a313917e-8501-454a-9905-e77ffafa81b5 req-28df1c93-c26d-4f43-8a94-516149c2b5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "name": "network-vif-unplugged", "status": "completed", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:32.915338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-a313917e-8501-454a-9905-e77ffafa81b5 req-28df1c93-c26d-4f43-8a94-516149c2b5b3 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:32.915778 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-a313917e-8501-454a-9905-e77ffafa81b5 req-28df1c93-c26d-4f43-8a94-516149c2b5b3 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:32.926819 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-a313917e-8501-454a-9905-e77ffafa81b5 req-28df1c93-c26d-4f43-8a94-516149c2b5b3 service nova] Creating event network-vif-unplugged:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:40:32.932167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-a313917e-8501-454a-9905-e77ffafa81b5 req-28df1c93-c26d-4f43-8a94-516149c2b5b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030518 Jun 15 19:40:32.932747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 160/314] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:33.198990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:33.199537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:33.206009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.206480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.207227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.207655 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.333331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:33.341786 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:33.343326 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:33.344468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-53d59226-464c-41aa-b1dc-c1c2fd42acdc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1725 microversion: 2.20 time: 0.149429 Jun 15 19:40:33.345027 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 155/315] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:33 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:33.365921 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb86ca9d-24d9-452e-b96d-e5638f5b5782"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:33.367076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:33.376071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.376514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.377273 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.377707 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.678226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-22d8b382-e0d9-44a5-a28b-77b57e53766a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316401 Jun 15 19:40:33.678939 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 161/316] 10.222.0.15 () {62 vars in 1363 bytes} [Wed Jun 15 19:40:33 2022] POST /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 19:40:33.792694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:33.793260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:33.799212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.799731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.800456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.800840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.892139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cd8dc4a8-04ef-420f-998f-20db85b3de21 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/action" status: 202 len: 0 microversion: 2.20 time: 0.103287 Jun 15 19:40:33.892698 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 156/317] 10.222.0.15 () {62 vars in 1318 bytes} [Wed Jun 15 19:40:33 2022] POST /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:40:33.900903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:33.901505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:33.908105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.908608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:33.909278 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:33.909703 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:34.056211 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:34.065803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:34.067448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:34.069312 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-05446ab9-c866-494a-8fbc-b076d5634457 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1751 microversion: 2.20 time: 0.172225 Jun 15 19:40:34.069879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 162/318] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:33 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:35.096991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:35.098785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:35.105828 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:35.106316 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:35.107234 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:35.107699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:35.264346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:35.273734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:35.275289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:35.276469 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c4622aa8-9729-4f75-bee7-2c4f72b96f14 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1751 microversion: 2.20 time: 0.189774 Jun 15 19:40:35.277028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 157/319] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:35 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:35.725586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f9c4f2b-b5da-4947-9295-dfffb4278442", "device": "/dev/sdb"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:40:35.727259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:35.733886 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:35.734383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:35.735183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:35.735621 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:36.052486 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e41bb6b5-394a-4cd3-aa5d-4a991ac4991a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "POST /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331054 Jun 15 19:40:36.055590 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 163/320] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:40:35 2022] POST /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:40:36.299351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:36.300399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:36.305534 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=78 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:36.310265 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:36.310705 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:36.311459 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:36.311883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:36.471432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:36.483999 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:36.486296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:36.488306 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-40d4e847-96a2-4630-ae38-5e5cc8b5e325 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.195933 Jun 15 19:40:36.489352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 158/321] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:36 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:37.511709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:37.512406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:37.515817 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=68 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:37.523014 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:37.523477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:37.524624 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:37.525068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:37.688742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:37.698705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:37.701830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:37.703560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5185b61e-9292-4bce-acad-dfb6eeeb783c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.198006 Jun 15 19:40:37.704532 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 164/322] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:37 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:38.724815 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:38.725476 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:38.732638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:38.733320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:38.734450 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:38.734993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:38.879760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:38.888321 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:38.889834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:38.891037 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0fad3ec0-b7a6-4a49-b83d-a2e3ab53f649 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.170859 Jun 15 19:40:38.891588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 159/323] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:38 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:39.909026 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:39.909693 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:39.916493 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:39.916934 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:39.917701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:39.918156 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:40.092352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:40.100874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:40.102440 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:40.103541 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-56373613-6c10-4c61-bd48-5c9ee9a85f0f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.198494 Jun 15 19:40:40.104109 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 165/324] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:39 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:41.121645 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:41.122290 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:41.129035 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:41.129568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:41.131243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:41.131682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:41.277212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:41.289294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:41.291652 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:41.294316 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b479d7a5-85f2-44f9-8229-0c28b5614604 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.176238 Jun 15 19:40:41.295037 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 160/325] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:41 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:40:42.314116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:42.314918 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:42.321096 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:42.321536 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:42.322351 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:42.323581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:42.463564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:42.472417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:42.473927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:42.475645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-74105175-a2e0-46db-aeb7-feeb0eaa020b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.166156 Jun 15 19:40:42.476209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 166/326] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:42 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:43.493635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:43.494342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:43.501284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:43.501733 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:43.502533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:43.503040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:43.506082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:43.722356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:43.732736 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:43.734901 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:43.736211 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f88babb3-bb52-44c5-9dc6-7c8e42f94720 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.246693 Jun 15 19:40:43.736870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 161/327] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:43 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:44.762356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:44.763054 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:44.769457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:44.769894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:44.770693 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:44.771110 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:44.911954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:44.920507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:44.922018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:44.923228 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bb393668-888b-41f3-9ea7-2072b9f017f9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.164684 Jun 15 19:40:44.923818 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 167/328] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:44 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:45.944832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:45.946278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:45.954069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:45.954904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:45.955921 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:45.956696 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:46.096572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:46.106142 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:46.107822 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:46.109069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2eb247f9-6032-450e-b98d-cb3132715f8c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.170985 Jun 15 19:40:46.109644 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 162/329] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:45 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:47.129095 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:47.129665 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:47.136646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:47.137094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:47.137857 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:47.138320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:47.272588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:47.281048 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:47.282586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:47.283743 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-39384e33-a3a6-4cf3-ba3f-a81c5cc5c2df tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.158691 Jun 15 19:40:47.284302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 168/330] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:47 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:48.303815 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:48.305164 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:48.319123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:48.320207 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:48.321644 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:48.322613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:48.471539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:48.480511 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:48.482002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:48.483173 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6c0fdf0c-3e2e-47c0-9b52-832ded9c04e8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.183942 Jun 15 19:40:48.483727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 163/331] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:48 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:49.502323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:49.502941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:49.509517 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:49.509956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:49.510747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:49.511174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:49.641469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:49.650580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:49.652117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:49.653277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ab2a0e8b-e73e-4c2f-a1b3-3bbb85c7598d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.155204 Jun 15 19:40:49.653838 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 169/332] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:49 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:50.672926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:50.673490 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:50.680800 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:50.681249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:50.682043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:50.682501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:50.813512 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:50.834652 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:50.836608 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:50.838236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f4ae2e1d-dbdf-4f11-abba-8c01ecf009c2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.169224 Jun 15 19:40:50.838813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 164/333] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:50 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:51.857441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:51.858048 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:51.865963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:51.866554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:51.867437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:51.867935 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:52.008208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:52.010437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:40:52.018356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:52.019846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:52.021023 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8991021a-e657-4040-a3b2-a65d733ab2a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.167880 Jun 15 19:40:52.021574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 170/334] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:51 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:53.040322 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:53.040950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:53.049063 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:53.049513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:53.050318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:53.050750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:53.197599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:53.205986 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:53.207562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:53.209255 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f4ae43c7-2fb1-42ab-81be-fbce22b977eb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.173692 Jun 15 19:40:53.209813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 165/335] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:53 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:54.227429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:54.228041 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:54.235843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:54.236290 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:54.237050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:54.237485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:54.375256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:54.384516 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:54.386024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:54.387213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6890d7a5-8360-423b-89c3-9fb6276fb8c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.163729 Jun 15 19:40:54.387774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 171/336] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:54 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:55.404635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:55.405258 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:55.412394 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:55.412860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:55.413610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:55.414036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:55.557509 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:55.566239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:55.567768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:55.568903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-30069a99-f689-4ef3-8ef3-3152a83ddf42 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.168126 Jun 15 19:40:55.569447 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 166/337] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:55 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:56.586110 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:56.586844 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:56.593431 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:56.593883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:56.594690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:56.595129 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:56.735768 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:56.744868 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:56.746533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:56.748105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5a043221-235e-4f27-bcce-4565ef0ef452 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.165523 Jun 15 19:40:56.748662 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 172/338] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:56 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:57.766247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:57.766855 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:57.774012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:57.774489 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:57.775253 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:57.775686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:57.902835 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:57.911670 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:57.913212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:57.914391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c0982ffd-deb3-41b1-a916-84e95b67cc5c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.152048 Jun 15 19:40:57.914950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 167/339] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:57 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:40:58.932849 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:40:58.933457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:40:58.940000 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:58.940440 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:58.941193 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:40:58.941624 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:40:59.073401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:59.082134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:59.084386 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:40:59.085542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4ba50bbd-8a21-449d-b9b7-221185e25859 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.156673 Jun 15 19:40:59.086118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 173/340] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:40:58 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:00.107000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:00.108067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:00.114738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:00.115291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:00.116064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:00.116495 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:00.249102 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:00.257743 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:00.259328 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:00.260496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b8349e05-a9c5-416f-8fb6-e745bcdf3cae tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.159420 Jun 15 19:41:00.261058 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 168/341] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:00 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:01.279309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:01.279912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:01.287142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:01.287586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:01.288346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:01.288775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:01.421358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:01.430558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:01.432063 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:01.433232 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-beb1a3f0-0231-4ea6-a38d-305f61c02d00 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.157889 Jun 15 19:41:01.433794 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 174/342] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:01 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:02.451942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:02.452804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:02.459095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:02.459537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:02.460301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:02.460734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:02.586058 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:02.594731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:02.596256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:02.597451 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c722907a-de34-464b-afa4-5037d2725e5e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.150038 Jun 15 19:41:02.598015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 169/343] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:02 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:03.615515 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:03.616052 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:03.622581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:03.623288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:03.624050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:03.624485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:03.756352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:03.764733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:03.766270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:03.767425 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bfb3e755-c976-4063-a084-44f97aaccf90 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.155914 Jun 15 19:41:03.767987 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 175/344] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:03 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:04.787249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:04.787848 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:04.795431 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:04.796007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:04.796788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:04.797225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:04.930435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:04.938927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:04.940427 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:04.942099 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-66240579-9fe0-497f-a1ac-c70bd63579fe tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.159076 Jun 15 19:41:04.942859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 170/345] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:04 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:05.661330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-59bbe8da-a70e-48b1-9299-6a0c373c0b88 req-12cebbb5-26da-48cd-8fbe-6d960d8d73ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "name": "network-vif-plugged", "status": "completed", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:05.671323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-59bbe8da-a70e-48b1-9299-6a0c373c0b88 req-12cebbb5-26da-48cd-8fbe-6d960d8d73ff service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:05.671987 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-59bbe8da-a70e-48b1-9299-6a0c373c0b88 req-12cebbb5-26da-48cd-8fbe-6d960d8d73ff service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:05.685483 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-59bbe8da-a70e-48b1-9299-6a0c373c0b88 req-12cebbb5-26da-48cd-8fbe-6d960d8d73ff service nova] Creating event network-vif-plugged:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:41:05.690497 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-59bbe8da-a70e-48b1-9299-6a0c373c0b88 req-12cebbb5-26da-48cd-8fbe-6d960d8d73ff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Jun 15 19:41:05.691099 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 176/346] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:05.960706 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:05.961338 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:05.967888 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:05.968329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:05.969095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:05.969511 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:06.102000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:06.114638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:06.116286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:06.117447 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-45a73fa5-94d6-4acd-a8a9-7c6f68d63b37 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.161223 Jun 15 19:41:06.118001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 171/347] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:05 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:07.136930 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:07.137618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:07.144507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:07.144946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:07.146281 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:07.146709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:07.282611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:07.291998 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:07.293571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:07.294733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6dc7bbee-d165-449c-8e1a-ff79050c4b83 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.162199 Jun 15 19:41:07.295308 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 177/348] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:07 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:41:08.312584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:08.313342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:08.315599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=28 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:08.321092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:08.321534 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:08.322332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:08.322761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:08.479535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:08.489875 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:08.492067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:08.493246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8db84e2e-3eb0-40d9-8caa-7207ce6a2fa8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.184495 Jun 15 19:41:08.493811 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 172/349] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:08 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:09.512520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:09.513117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:09.515599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=28 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:09.520879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:09.521320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:09.522118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:09.522553 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:09.673080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:09.682119 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:09.683618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:09.684830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-382e84b0-4d21-473b-9687-290362baf1bb tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.176179 Jun 15 19:41:09.685388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 178/350] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:09 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:10.703192 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:10.703798 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:10.710374 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:10.710818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:10.711582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:10.712013 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:10.851651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:10.860450 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:10.861947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:10.863160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-01e39fa4-cc54-4b89-a6f0-48877ce084a8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1809 microversion: 2.20 time: 0.163957 Jun 15 19:41:10.863721 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 173/351] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:10 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:11.883083 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:11.883641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:11.890394 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:11.890844 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:11.891612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:11.892044 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:12.024326 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:12.032686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:12.034276 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:12.035414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f34e4f84-dd55-414c-9658-22261ed3e76e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1796 microversion: 2.20 time: 0.156705 Jun 15 19:41:12.035967 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 179/352] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:11 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:41:12.687266 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:12.687741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:12.694218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:12.695313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:12.696073 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:12.696508 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:12.817769 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lazy-loading 'services' on Instance uuid ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:12.928294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bf054c85-04d3-4c2c-a81e-41dee2715f1e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5/os-volume_attachments/1f9c4f2b-b5da-4947-9295-dfffb4278442" status: 202 len: 0 microversion: 2.1 time: 0.244722 Jun 15 19:41:12.928805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 174/353] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:41:12 2022] DELETE /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5/os-volume_attachments/1f9c4f2b-b5da-4947-9295-dfffb4278442 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:14.042206 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:14.042759 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:14.049130 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:14.049608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:14.050431 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:14.050854 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:14.077561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:41:14.165771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-299391cd-abaa-4cc9-8e75-57c6c2c05acb tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 204 len: 0 microversion: 2.1 time: 0.128239 Jun 15 19:41:14.166511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 180/354] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:41:14 2022] DELETE /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:41:14.177127 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:14.177801 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:14.185413 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:14.185616 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:14.186375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:14.186809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:14.190111 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:14.322005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:14.329601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7b437b10-b92b-4346-9334-7e318a92eeaf tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1512 microversion: 2.1 time: 0.158099 Jun 15 19:41:14.330194 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 175/355] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:14 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:15.347925 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:15.348666 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:15.355732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:15.356176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:15.356923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:15.357349 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:15.487999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:15.495702 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ac31cfeb-c601-4a74-828a-bc1c250ea200 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1512 microversion: 2.1 time: 0.152027 Jun 15 19:41:15.496274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 181/356] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:15 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:16.512904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:16.513806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:16.520523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:16.520965 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:16.521889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:16.522357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:16.672873 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:16.682346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-941cf4fa-4a52-4b45-8fe8-adced95848d3 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 200 len: 1512 microversion: 2.1 time: 0.173272 Jun 15 19:41:16.683095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 176/357] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:16 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:16.734507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-06931a94-dd61-42a1-b85d-9e1d3fde7f1f req-5524780b-981c-4a01-8018-3a0fcdae0533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5", "name": "network-vif-deleted", "tag": "b219c8bb-f080-4767-a6ee-30df4ef8dfec"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:16.744312 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-06931a94-dd61-42a1-b85d-9e1d3fde7f1f req-5524780b-981c-4a01-8018-3a0fcdae0533 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:16.744735 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-06931a94-dd61-42a1-b85d-9e1d3fde7f1f req-5524780b-981c-4a01-8018-3a0fcdae0533 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:16.758360 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-06931a94-dd61-42a1-b85d-9e1d3fde7f1f req-5524780b-981c-4a01-8018-3a0fcdae0533 service nova] Creating event network-vif-deleted:b219c8bb-f080-4767-a6ee-30df4ef8dfec for instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 on hv-cinder-84456 Jun 15 19:41:16.763770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-06931a94-dd61-42a1-b85d-9e1d3fde7f1f req-5524780b-981c-4a01-8018-3a0fcdae0533 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032667 Jun 15 19:41:16.764221 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 182/358] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:17.700284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:17.700908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:17.708072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:17.708593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:17.709366 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:17.709799 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:17.723443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] HTTP exception thrown: Instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 could not be found. Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Request method failure captured: Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 HTTP/1.1 Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjWO13S6AL3Yj2MSQKkeL4a4h3_RkgOJ9aMStpi64tuL8JtjimNLS1RVXukjr4KYDa36cPTH9F7hJvnDDuRd5VP_h2St2tcXCtkzeWWsRLEQQSNatJxTQQwyLApTNCT4OeOE1cvkQuBukD5jfcRxHlm2d8vIIaNnCpMPTfujsAohoRc Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 526f86dc251440b9b50e325de4efb751 Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesSnapshotTestJSON-150526058 Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:41:17.725117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/526f86dc251440b9b50e325de4efb751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_526f86dc251440b9b50e325de4efb751", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/526f86dc251440b9b50e325de4efb751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/526f86dc251440b9b50e325de4efb751"}]}] Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesSnapshotTestJSON-150526058 Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 526f86dc251440b9b50e325de4efb751 Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-150526058 Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesSnapshotTestJSON-150526058-project Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: d6619b929f1844f48e0aa452ff5b8b51 Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesSnapshotTestJSON-150526058-project Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 could not be found. Jun 15 19:41:17.726673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5'} Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 could not be found. Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:41:17.727516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 could not be found. Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 could not be found. Jun 15 19:41:17.728767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:17.730162 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Returning 404 to user: Instance ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:41:17.730162 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-50cd2a85-3d2c-4d8e-9c36-7cb0ce2dd122 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5" status: 404 len: 111 microversion: 2.1 time: 0.030803 Jun 15 19:41:17.730162 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 177/359] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:17 2022] GET /compute/v2.1/servers/ac35d1c6-c5d5-48a6-b735-f6b25e9d94c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:41:26.636885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2120585484", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "networks": [{"uuid": "c7953e1c-32f1-43bd-a8e2-687b003d29d3"}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:26.693058 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] validate_networks() for [('c7953e1c-32f1-43bd-a8e2-687b003d29d3', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:41:26.751010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:27.059242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:41:27.059698 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:41:27.060184 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:41:27.060639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:41:27.061056 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:41:27.070931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:27.071388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:27.072164 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:27.072588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:27.090645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Getting quotas for project 526f86dc251440b9b50e325de4efb751. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:41:27.096333 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Getting quotas for user d6619b929f1844f48e0aa452ff5b8b51 and project 526f86dc251440b9b50e325de4efb751. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:41:27.109289 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:41:27.111932 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:41:27.158887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c119d8a6-28ac-420e-8f87-a43eedd0cb60 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527382 Jun 15 19:41:27.159557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 183/360] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:41:27.170330 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cdd00ddf-8654-4003-a72b-8ce464221f11 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:27.171109 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cdd00ddf-8654-4003-a72b-8ce464221f11 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:27.231850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cdd00ddf-8654-4003-a72b-8ce464221f11 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:27.239511 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cdd00ddf-8654-4003-a72b-8ce464221f11 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1219 microversion: 2.1 time: 0.073187 Jun 15 19:41:27.240100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 178/361] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:27 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:28.258544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:28.259467 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:28.266818 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:28.267391 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:28.268293 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:28.268813 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:28.348240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:28.361750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-65d67b7f-33f4-426f-9867-058095ec421e tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1279 microversion: 2.1 time: 0.107875 Jun 15 19:41:28.371871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 184/362] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:28 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:29.346715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:29.347343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:29.354807 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=13 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:29.358281 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.359130 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.360036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.360488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.380709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:29.382446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:29.391760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.392523 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.394369 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.395288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.488244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lazy-loading 'services' on Instance uuid b7a4ed60-945d-46a9-8f53-ead05148049e {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:29.562523 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:29.572953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-163cd4bd-a173-4808-ae43-7cfca4c67ed2 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.197737 Jun 15 19:41:29.573539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 185/363] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:29 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:29.578778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0937cb9a-a178-4079-8285-55b5f36739b6 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-volume_attachments/8d59aa27-3da9-450e-aeeb-a9f3e43f49df" status: 202 len: 0 microversion: 2.1 time: 0.236499 Jun 15 19:41:29.582951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 179/364] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:41:29 2022] DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-volume_attachments/8d59aa27-3da9-450e-aeeb-a9f3e43f49df => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:29.590124 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-174f89c8-0987-4f9d-8ad2-c6a378cb6cc7 req-b4d03446-d05a-4ca8-bd27-ddeaa863f2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f2e841-11f5-4b38-aa45-8a95492cec45", "tag": "cb276915-e785-4cf2-b1e5-e26ab501e7cc"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:29.611046 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-174f89c8-0987-4f9d-8ad2-c6a378cb6cc7 req-b4d03446-d05a-4ca8-bd27-ddeaa863f2e0 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.611996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-174f89c8-0987-4f9d-8ad2-c6a378cb6cc7 req-b4d03446-d05a-4ca8-bd27-ddeaa863f2e0 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.625943 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-174f89c8-0987-4f9d-8ad2-c6a378cb6cc7 req-b4d03446-d05a-4ca8-bd27-ddeaa863f2e0 service nova] Creating event network-changed:cb276915-e785-4cf2-b1e5-e26ab501e7cc for instance 24f2e841-11f5-4b38-aa45-8a95492cec45 on hv-cinder-84456 Jun 15 19:41:29.632824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-174f89c8-0987-4f9d-8ad2-c6a378cb6cc7 req-b4d03446-d05a-4ca8-bd27-ddeaa863f2e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053420 Jun 15 19:41:29.633730 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 186/365] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:29.788963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:29.789601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:29.796590 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.797031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.797810 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.798406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.821930 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0ce21c93-f0eb-49f4-8d4b-67a2057f664b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/ips" status: 200 len: 150 microversion: 2.1 time: 0.037191 Jun 15 19:41:29.822531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 180/366] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:41:29 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:29.833684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb484def-84ae-4a02-ba9c-db20131036be"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:29.834872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:29.841750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.842215 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.842970 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.843397 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.922077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Invalid volume: volume bb484def-84ae-4a02-ba9c-db20131036be is already attached to instances: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: POST /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/os-volume_attachments HTTP/1.1 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 74 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:41:29.923747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {"volumeAttachment": {"volumeId": "bb484def-84ae-4a02-ba9c-db20131036be"}} Jun 15 19:41:29.925192 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Invalid volume: volume bb484def-84ae-4a02-ba9c-db20131036be is already attached to instances: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'server_id': '26e7c26a-2656-4871-bc8c-fff9ca495889', 'body': {'volumeAttachment': {'volumeId': 'bb484def-84ae-4a02-ba9c-db20131036be'}}} Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bb484def-84ae-4a02-ba9c-db20131036be is already attached to instances: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:29.925991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bb484def-84ae-4a02-ba9c-db20131036be is already attached to instances: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:29.928001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bb484def-84ae-4a02-ba9c-db20131036be is already attached to instances: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 400 to user: Invalid volume: volume bb484def-84ae-4a02-ba9c-db20131036be is already attached to instances: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bf3deab4-3b41-4112-a680-79fca0b62e15 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096008 Jun 15 19:41:29.929147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 187/367] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:41:29 2022] POST /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:41:29.934014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:29.934538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:29.940521 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.940967 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.941723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:29.942181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:29.967734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:41:30.043061 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4c0b6e28-3fd6-46a8-bd03-afce16588804 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 204 len: 0 microversion: 2.1 time: 0.112592 Jun 15 19:41:30.043645 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 181/368] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:41:29 2022] DELETE /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:41:30.051803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:30.052405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:30.059725 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:30.060171 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:30.060939 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:30.061753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:30.194358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:30.202509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-61533533-a21f-4ed9-bade-f54e33aa004f tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1680 microversion: 2.1 time: 0.154510 Jun 15 19:41:30.203073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 188/369] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:30 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:30.591516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:30.592216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:30.598904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:30.599354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:30.600118 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:30.600642 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:30.745480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:30.753380 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-54851d67-7462-459d-9804-99d9a44d0691 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.166029 Jun 15 19:41:30.753940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 182/370] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:30 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:30.989088 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb6ba6cd-d871-4f60-ab8d-1c920252a85f"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:30.990179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:30.997645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:30.998115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:30.998879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:30.999310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:31.220927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:31.221562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:31.228518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:31.228958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:31.229715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:31.230184 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:31.363023 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:31.370706 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-992931f9-eb28-4a43-9421-1a439e81a310 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1680 microversion: 2.1 time: 0.153709 Jun 15 19:41:31.371277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 183/371] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:31 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:31.761954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4120b6a9-3eec-4bd8-8202-321c0a83b526 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776595 Jun 15 19:41:31.762779 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 189/372] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:41:30 2022] POST /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:31.771435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:31.772229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:31.795193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:31.795917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:31.796804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:31.800977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:31.941868 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:31.949996 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-dbb290c6-471c-4503-9cf6-21babb73198a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.183342 Jun 15 19:41:31.950587 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 184/373] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:31 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:32.389380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:32.390082 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:32.396634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:32.397081 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:32.397850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:32.398318 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:32.534102 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:32.542893 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f9b8066d-8fdf-40cf-a1d4-70ff9647c5f3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1680 microversion: 2.1 time: 0.158133 Jun 15 19:41:32.543532 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 190/374] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:32 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:32.872048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ca9acde4-afe1-4d22-b6ad-eeb3c42fcefc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:32.882723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca9acde4-afe1-4d22-b6ad-eeb3c42fcefc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:32.883517 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca9acde4-afe1-4d22-b6ad-eeb3c42fcefc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:32.917889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ca9acde4-afe1-4d22-b6ad-eeb3c42fcefc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Going to try to stop instance {{(pid=129334) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 19:41:32.972704 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:32.976010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:32.981148 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ca9acde4-afe1-4d22-b6ad-eeb3c42fcefc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action" status: 202 len: 0 microversion: 2.1 time: 0.114710 Jun 15 19:41:32.985467 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 185/375] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:41:32 2022] POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:32.990288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:32.991185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:32.992430 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:32.993183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:33.009156 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:33.009866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:33.016540 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:33.017021 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:33.017829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:33.018310 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:33.218503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:33.220690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:33.227054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-29aedbe3-5a22-4ba3-abc1-2ced4a9625a1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.224626 Jun 15 19:41:33.228390 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 186/376] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:32 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:33.231502 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b9587abb-ce8e-43dc-bb8a-b0ee45fbab81 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.266575 Jun 15 19:41:33.232694 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 191/377] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:32 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:33.561578 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:33.562207 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:33.570239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:33.572016 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:33.573123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:33.573635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:33.728989 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:33.736952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-75f8475f-7f0e-4429-8f0a-5f6f44b2200b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1680 microversion: 2.1 time: 0.179133 Jun 15 19:41:33.737732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 187/378] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:33 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:34.251953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:34.252781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:34.253659 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:34.256068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:34.263503 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.264257 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.265050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.265715 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.268067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.268841 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.270104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.271012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.748914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:34.751978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:34.759055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e34d1cf5-e4f5-4ffc-b345-8a5dfb43f15f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.512390 Jun 15 19:41:34.759947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 188/379] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:34 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:34.760744 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bcb40db8-61d3-4c79-8124-9cd02bc51a4e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.517956 Jun 15 19:41:34.761613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 192/380] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:34 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:34.766125 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:34.766740 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:34.766870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-99dbe2bd-2301-4165-8670-8df78cd2a1fc req-002b976d-0b51-4423-9f39-d2d8285e48ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e7c26a-2656-4871-bc8c-fff9ca495889", "name": "network-vif-deleted", "tag": "38c5a7a2-3e50-419d-842c-89b9faf77314"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:34.773814 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.774304 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.775092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.776211 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.785192 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-99dbe2bd-2301-4165-8670-8df78cd2a1fc req-002b976d-0b51-4423-9f39-d2d8285e48ea service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.785867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-99dbe2bd-2301-4165-8670-8df78cd2a1fc req-002b976d-0b51-4423-9f39-d2d8285e48ea service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.801006 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-99dbe2bd-2301-4165-8670-8df78cd2a1fc req-002b976d-0b51-4423-9f39-d2d8285e48ea service nova] Creating event network-vif-deleted:38c5a7a2-3e50-419d-842c-89b9faf77314 for instance 26e7c26a-2656-4871-bc8c-fff9ca495889 on hv-cinder-84456 Jun 15 19:41:34.808246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-99dbe2bd-2301-4165-8670-8df78cd2a1fc req-002b976d-0b51-4423-9f39-d2d8285e48ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046345 Jun 15 19:41:34.809806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 189/381] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:34.811942 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:34.812360 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:34.812696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lazy-loading 'fault' on Instance uuid 26e7c26a-2656-4871-bc8c-fff9ca495889 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:34.858862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:34.868514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-88ec584d-ab23-422b-a6ca-9c0ee7db5373 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 200 len: 1330 microversion: 2.1 time: 0.105815 Jun 15 19:41:34.869161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 193/382] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:34 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:35.779824 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:35.780615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:35.780913 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:35.782073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:35.790946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:35.792187 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:35.793327 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:35.794406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:35.798018 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:35.798908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:35.804643 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:35.805521 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:36.032790 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:36.041745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bc6f3056-27cc-4035-892b-752f2f54c90c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.264987 Jun 15 19:41:36.042711 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 194/383] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:35 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:36.051726 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:36.057971 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:36.058917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:36.059310 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6ea0bf38-3c4c-4ff9-8e81-cdfff5dd5d07 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.282027 Jun 15 19:41:36.060025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 190/384] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:35 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:36.065608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:36.066400 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:36.067370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:36.067714 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-fbc18851-63ae-4456-8472-39a79bcdbc7c req-adaaa3a3-844e-4176-8a2b-712422e12175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f2e841-11f5-4b38-aa45-8a95492cec45", "name": "network-vif-plugged", "status": "completed", "tag": "cb276915-e785-4cf2-b1e5-e26ab501e7cc"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:36.068229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:36.081220 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-fbc18851-63ae-4456-8472-39a79bcdbc7c req-adaaa3a3-844e-4176-8a2b-712422e12175 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:36.081697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-fbc18851-63ae-4456-8472-39a79bcdbc7c req-adaaa3a3-844e-4176-8a2b-712422e12175 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:36.085413 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 HTTP/1.1 Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:41:36.088405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:41:36.089843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '26e7c26a-2656-4871-bc8c-fff9ca495889'} Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:41:36.090671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:41:36.096242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:41:36.099160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:41:36.099160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-df2b6262-0845-4dfe-a975-3f8641a88a08 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 404 len: 111 microversion: 2.1 time: 0.036976 Jun 15 19:41:36.099160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 195/385] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:36 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:41:36.100090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f89bb317-8ed6-468b-871a-56b5d575cca6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '.version_select at 0x7f164615c040>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:36.100623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-fbc18851-63ae-4456-8472-39a79bcdbc7c req-adaaa3a3-844e-4176-8a2b-712422e12175 service nova] Creating event network-vif-plugged:cb276915-e785-4cf2-b1e5-e26ab501e7cc for instance 24f2e841-11f5-4b38-aa45-8a95492cec45 on hv-cinder-84456 Jun 15 19:41:36.106267 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-fbc18851-63ae-4456-8472-39a79bcdbc7c req-adaaa3a3-844e-4176-8a2b-712422e12175 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044390 Jun 15 19:41:36.110686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 191/386] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:36.156236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f89bb317-8ed6-468b-871a-56b5d575cca6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945975737" status: 202 len: 0 microversion: 2.1 time: 0.059877 Jun 15 19:41:36.158646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 196/387] 10.222.0.15 () {58 vars in 1217 bytes} [Wed Jun 15 19:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945975737 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:36.935532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:36.936105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:36.942542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:36.942993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:36.943763 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:36.944192 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.028555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lazy-loading 'services' on Instance uuid 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:37.060188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:37.060824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:37.066923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:37.067353 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.068109 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:37.068533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.084764 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:37.103316 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c43cc46d-c192-4dfb-9ea1-fdbd6598e8bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments/bb484def-84ae-4a02-ba9c-db20131036be" status: 202 len: 0 microversion: 2.1 time: 0.172403 Jun 15 19:41:37.103835 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 192/388] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:41:36 2022] DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments/bb484def-84ae-4a02-ba9c-db20131036be => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:37.104277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:37.111214 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:37.111916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:37.119015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:37.119463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.120292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:37.120676 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.125123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:37.241885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:37.266933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:37.275125 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d00d0498-1836-4676-8299-8dfd9ad9fdc3 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.220000 Jun 15 19:41:37.275945 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 197/389] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:37 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:37.280931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:37.282344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:37.290712 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:37.291257 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.292245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:37.292783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:37.315990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:37.325648 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b68d4b7c-b992-4723-859c-62f363eb3b44 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1319 microversion: 2.1 time: 0.219577 Jun 15 19:41:37.326035 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-00274821-1b71-4c81-ae19-19cef911f1f0 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048819 Jun 15 19:41:37.326260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 193/390] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:37 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:37.326790 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 198/391] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:41:37 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:38.292692 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:38.293305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:38.300260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.300750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.301626 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.302115 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.340323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:38.342267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:38.351391 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.351968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.352930 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.353767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.392438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a67185d6-ce10-4dbe-b26e-c14f31ded96a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058685 Jun 15 19:41:38.393129 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 199/392] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:41:38 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:38.399576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:38.400341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:38.407972 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.408788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.409964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.410290 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.450434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:38.458963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f9209e82-0f48-4e79-9091-a5beeead1f18 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.169718 Jun 15 19:41:38.459698 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 194/393] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:38 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:38.554270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:38.558341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:38.564683 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a6e49b38-18ff-46ef-b11e-8605ccbe0a51 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1507 microversion: 2.1 time: 0.170365 Jun 15 19:41:38.565332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 200/394] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:38 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:38.581943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "260382fa-e4ae-4592-a258-439615fb85fe", "device": "/dev/sdb"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:38.583615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:38.585460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:38.590727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.591160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:38.591918 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:38.592343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:39.063919 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-598350b6-2f0f-4b9a-bcdf-3778f67635df tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "POST /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485748 Jun 15 19:41:39.064575 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 195/395] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:41:38 2022] POST /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:39.409097 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:39.410707 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:39.421774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:39.422508 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:39.423302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:39.423797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:39.463860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-81325480-4fc4-4559-908c-6d1703e16d49 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062079 Jun 15 19:41:39.464442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 201/396] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:41:39 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:41:39.478935 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:39.479741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:39.486464 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:39.486918 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:39.490822 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:39.490822 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:39.637421 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:39.645790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c735b7fc-81a1-4de2-9074-81a11da7ffd2 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.172573 Jun 15 19:41:39.646425 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 196/397] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:39 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:40.476183 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:40.477620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:40.479988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:40.486081 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.486549 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.487345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.487786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.513308 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:40.514547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:40.528459 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.528931 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.529954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.530626 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.534752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-774db110-53d4-4154-97a5-f3aec5828a0d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061183 Jun 15 19:41:40.535750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 202/398] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:41:40 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:41:40.562151 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'flavor' on Instance uuid f4eda938-2478-4ddd-9f99-974f3ffe7123 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:40.597471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:40.598209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:40.605517 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.605971 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.606773 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.607208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.636437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:41:40.730484 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-413e3df4-90c9-4c62-9363-91eede1ed431 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 204 len: 0 microversion: 2.1 time: 0.136864 Jun 15 19:41:40.731033 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 203/399] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:41:40 2022] DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:41:40.732333 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-37634838-208d-439c-8c63-d7529a93a865 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/action" status: 200 len: 32 microversion: 2.1 time: 0.225027 Jun 15 19:41:40.738436 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 197/400] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:41:40 2022] POST /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/action => generated 32 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 19:41:40.743302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:40.744112 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:40.745082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:40.746077 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:40.751786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.752511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.753302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.753587 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.753903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.754027 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.754859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.755252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.956207 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:40.959229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:40.965096 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cfb8abf4-a8c8-4f62-ba8c-62c65f2dfb63 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.232766 Jun 15 19:41:40.965880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 204/401] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:40 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:40.968014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2ae0b4c8-c9ac-494b-8257-4ebcfe2bc7ae tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1680 microversion: 2.1 time: 0.228786 Jun 15 19:41:40.968569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 198/402] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:40 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:40.975710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:40.975710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:40.978046 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.978526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:40.979320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:40.979738 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:41.123124 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:41.131405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8946c86e-7f44-4789-9c52-49e8d154dc1d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.164670 Jun 15 19:41:41.131982 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 205/403] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:40 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:41.984533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:41.985127 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:41.987428 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:41.988193 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:41.991926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:41.992954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:41.993731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:41.994195 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:41.996405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:41.997180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:41.997962 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:42.000144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:42.195624 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:42.203699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7913b467-e85b-4ce4-b7ce-f2761bffccf1 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1680 microversion: 2.1 time: 0.221503 Jun 15 19:41:42.204286 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 206/404] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:41 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:42.208758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:42.209399 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:42.211920 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:42.215721 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:42.216177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:42.216963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:42.217392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:42.223229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e87ec0f7-986e-4583-9ba4-ccaf34f933ff tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.242445 Jun 15 19:41:42.224066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 199/405] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:41 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:42.377748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:42.389334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-44bf8686-f743-4c4e-8c8e-6ff85a007122 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.183925 Jun 15 19:41:42.390106 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 207/406] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:42 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:43.220982 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:43.221660 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:43.228602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.229124 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.230236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.230934 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.241675 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:43.242957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:43.251756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.252214 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.253336 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.254118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.478044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:43.485083 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:43.495246 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a0b93f23-6ce4-446b-9470-a87d3ff93544 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1678 microversion: 2.1 time: 0.257719 Jun 15 19:41:43.495977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 208/407] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:43 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:43.499810 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f8f490af-6222-4ea7-848f-ecc684949167 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 200 len: 1680 microversion: 2.1 time: 0.282647 Jun 15 19:41:43.500625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 200/408] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:43 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 1680 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:43.504554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:43.505171 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:43.512213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.512690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.513645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.514396 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.672215 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:43.680743 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-639ce3a0-5396-4d48-93e2-348680196e8e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.183772 Jun 15 19:41:43.681309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 209/409] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:43 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:43.916453 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-108be4f5-42bb-4249-9c8e-f1a454998caf req-d4304af7-d0f9-4721-abaa-2d068b8832ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d725dd8-b126-49c5-8d0f-3a02cb3331d2", "name": "network-vif-deleted", "tag": "30a09c0c-5cec-4b08-8e71-71e48f7bd23a"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:43.925829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-108be4f5-42bb-4249-9c8e-f1a454998caf req-d4304af7-d0f9-4721-abaa-2d068b8832ac service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:43.926596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-108be4f5-42bb-4249-9c8e-f1a454998caf req-d4304af7-d0f9-4721-abaa-2d068b8832ac service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:43.943971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-108be4f5-42bb-4249-9c8e-f1a454998caf req-d4304af7-d0f9-4721-abaa-2d068b8832ac service nova] Creating event network-vif-deleted:30a09c0c-5cec-4b08-8e71-71e48f7bd23a for instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 on hv-cinder-84456 Jun 15 19:41:43.949640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-108be4f5-42bb-4249-9c8e-f1a454998caf req-d4304af7-d0f9-4721-abaa-2d068b8832ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037274 Jun 15 19:41:43.950549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 201/410] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:44.513670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:44.514422 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:44.524270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.524968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.526358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.527401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.527602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:44.528793 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:44.538539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.539252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.540708 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.541365 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.559429 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 HTTP/1.1 Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:41:44.561602 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:41:44.563301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '9d725dd8-b126-49c5-8d0f-3a02cb3331d2'} Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:41:44.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:41:44.565833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:41:44.567075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:41:44.568430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9dc58e07-ffe7-4015-a06d-17388d6ff5e6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 404 len: 111 microversion: 2.1 time: 0.048591 Jun 15 19:41:44.573193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 202/411] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:44 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:41:44.578004 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-dd748bc3-7918-4435-8872-cd9ab767f16d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '.version_select at 0x7f16459daa60>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:44.597133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-dd748bc3-7918-4435-8872-cd9ab767f16d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940220290" status: 202 len: 0 microversion: 2.1 time: 0.022842 Jun 15 19:41:44.597726 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 203/412] 10.222.0.15 () {58 vars in 1220 bytes} [Wed Jun 15 19:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940220290 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 19:41:44.683472 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:44.693483 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0e42eed7-5abd-4948-b6a4-a8dd962acdf1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1655 microversion: 2.1 time: 0.181988 Jun 15 19:41:44.694458 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 210/413] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:44 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:44.706664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:44.706664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:44.710730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.711317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.712451 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.713089 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.718297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9483ac21-01e7-4baf-b367-46ad7d4aaa47 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:44.732772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9483ac21-01e7-4baf-b367-46ad7d4aaa47 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.733321 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9483ac21-01e7-4baf-b367-46ad7d4aaa47 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.779448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9483ac21-01e7-4baf-b367-46ad7d4aaa47 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Going to try to start instance {{(pid=129333) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 19:41:44.872346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9483ac21-01e7-4baf-b367-46ad7d4aaa47 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action" status: 202 len: 0 microversion: 2.1 time: 0.161787 Jun 15 19:41:44.876884 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 211/414] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:41:44 2022] POST /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:44.886277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:44.888274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:44.896775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.898069 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.899461 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:44.900365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:44.911219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:44.940370 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8c86f696-03cd-48e2-aed0-0a13503b00e5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.245726 Jun 15 19:41:44.941083 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 204/415] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:44 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:45.079540 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:45.088453 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-886ffae6-9e09-4a55-bc73-6b163a908a02 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1664 microversion: 2.1 time: 0.208470 Jun 15 19:41:45.089628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 212/416] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:44 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:45.702661 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-da61a492-6cc7-4fec-8d71-cac31ffe2cbd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: .version_select at 0x7f16458739d0>, body: {"keypair": {"name": "tempest-keypair-580426683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYmtqMYcdhq5QBELPe0kw3weJa8cx51201D5gACVBrN4hPfkbBLzSqzJUpL6eYBnYxm3nheETRgGyNn2A6IDxLI3cf73MowDASIhHgIE4AJscToCykv7+QDuAWEOJzSug=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:45.729208 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-da61a492-6cc7-4fec-8d71-cac31ffe2cbd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:41:45.733889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-da61a492-6cc7-4fec-8d71-cac31ffe2cbd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:41:45.763971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-da61a492-6cc7-4fec-8d71-cac31ffe2cbd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065133 Jun 15 19:41:45.770847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 205/417] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:41:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:41:45.959733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:45.961645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:45.972009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:45.972715 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:45.974366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:45.975250 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:46.110952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:46.111569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:46.123231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:46.123732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:46.124524 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:46.124963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:46.232215 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:46.241392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-691e851c-0596-4516-bf1a-7686a6075829 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.286282 Jun 15 19:41:46.242640 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 213/418] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:45 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:46.311288 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:46.323147 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9fd16a14-a255-4ec5-bcca-466eacab375b tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1664 microversion: 2.1 time: 0.217496 Jun 15 19:41:46.324040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 206/419] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:46 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:47.264139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:47.264139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:47.272888 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:47.274557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:47.275407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:47.275855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:47.347076 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:47.348737 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:47.358113 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:47.359100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:47.360679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:47.361625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:47.513325 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:47.517082 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:47.524128 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-484042b4-6b08-4c89-a68d-2af8497e9968 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.266680 Jun 15 19:41:47.524843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 214/420] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:47 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:47.530263 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-484288858", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ed2ffb-2899-41f6-afeb-0cd1a1d94e79"}], "security_groups": [{"name": "tempest-securitygroup--80807147"}], "key_name": "tempest-keypair-580426683", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:47.572574 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:47.582510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fe54fa6e-a9c1-4c80-a8da-f86ab44d3408 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1668 microversion: 2.1 time: 0.241170 Jun 15 19:41:47.583081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 207/421] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:47 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1668 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:47.643245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] validate_networks() for [('25ed2ffb-2899-41f6-afeb-0cd1a1d94e79', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:41:48.068080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:41:48.068582 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:41:48.069149 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:41:48.069654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:41:48.070171 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:41:48.080557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:48.081039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:48.081948 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:48.082492 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:48.100421 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:41:48.110758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:41:48.123080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:41:48.125389 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:41:48.173628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-06943bc3-de27-414e-b3fd-f8e81cecf4ec tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.647671 Jun 15 19:41:48.174608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 215/422] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:41:47 2022] POST /compute/v2.1/servers => generated 400 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:41:48.188653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-48dfcbfe-f256-470f-9bbb-37aa54494aca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:48.189292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-48dfcbfe-f256-470f-9bbb-37aa54494aca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:48.252708 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-48dfcbfe-f256-470f-9bbb-37aa54494aca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:48.259781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-48dfcbfe-f256-470f-9bbb-37aa54494aca tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1240 microversion: 2.1 time: 0.076418 Jun 15 19:41:48.260356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 208/423] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:48 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:48.546605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:48.547264 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:48.553525 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:48.554238 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:48.555053 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:48.555760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:48.714740 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:48.722726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ff013717-1e95-4d2e-9392-bfab28c9e755 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.180668 Jun 15 19:41:48.723285 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 216/424] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:48 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:49.279523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:49.280203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:49.286812 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:49.287261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:49.288015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:49.288444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:49.350898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:49.359253 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f5ddb2b1-fe5f-496c-93ef-d36fcd2f1cd3 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1244 microversion: 2.1 time: 0.083527 Jun 15 19:41:49.359829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 209/425] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:49 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:49.740779 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:49.741449 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:49.751983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:49.752684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:49.753903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:49.754634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:49.895371 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:49.904211 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c74ea02f-cdb5-4148-96e3-384afb5c41b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.168018 Jun 15 19:41:49.904786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 217/426] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:49 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:50.376586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:50.377202 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:50.384607 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:50.385056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:50.385838 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:50.386311 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:50.452161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:50.455803 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:50.461423 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-dcf9a11c-6cd2-403f-bf7d-4b7af84dc1fa tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1244 microversion: 2.1 time: 0.088215 Jun 15 19:41:50.462025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 210/427] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:50 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:50.922692 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:50.923631 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:50.932568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:50.933019 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:50.933955 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:50.934449 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:51.094456 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:51.104997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bea425a3-f838-4683-90c1-7adc9006cd71 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.186391 Jun 15 19:41:51.106282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 218/428] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:50 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:51.479384 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:51.480780 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:51.487964 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:51.488411 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:51.489588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:51.489972 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:51.565348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:51.573759 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0afb8885-7603-4ca2-abfa-53778c774b6d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1300 microversion: 2.1 time: 0.098892 Jun 15 19:41:51.574533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 211/429] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:51 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:52.123422 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:52.124176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:52.131765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:52.133074 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:52.134041 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:52.134837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:52.303766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:52.319136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4366e124-6022-4f0f-a68f-4f801fc8e0fa tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.200063 Jun 15 19:41:52.320462 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 219/430] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:52 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:52.591069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:52.591902 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:52.600149 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:52.600603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:52.602146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:52.602584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:52.753906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:52.761866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5d753f14-030a-40a6-82ab-0f0854bfc8e2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.174908 Jun 15 19:41:52.762484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 212/431] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:52 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:53.338384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:53.339099 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:53.345871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:53.346354 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:53.347125 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:53.347555 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:53.482357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:53.490439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f75bb387-23a9-4021-aa31-d37f490864d1 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.156698 Jun 15 19:41:53.491005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 220/432] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:53 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:53.779761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:53.780371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:53.787135 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:53.787585 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:53.788947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:53.789386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:53.921588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:53.929104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-506b59c8-94af-4a78-9e19-9a0db83f5507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.153201 Jun 15 19:41:53.929664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 213/433] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:53 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:54.509150 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:54.510161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:54.517110 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:54.517559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:54.518364 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:54.518804 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:54.653243 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:54.666563 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-abfc190b-315d-43e5-8592-e5a40070b9a2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.161859 Jun 15 19:41:54.667142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 221/434] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:54 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:54.949812 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:54.950458 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:54.957075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:54.957542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:54.958334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:54.958760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.312914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:55.322933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6cff657d-795b-40bc-a9d1-a7f41e7dd350 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.376938 Jun 15 19:41:55.323862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 214/435] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:54 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:55.409679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:55.410525 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:55.418777 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.419231 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.420167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.420463 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.464640 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-08e5cc80-8dfb-4072-97e8-81c860628cac tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments/fb86ca9d-24d9-452e-b96d-e5638f5b5782" status: 200 len: 194 microversion: 2.20 time: 0.060361 Jun 15 19:41:55.465501 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 222/436] 10.222.0.15 () {60 vars in 1453 bytes} [Wed Jun 15 19:41:55 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments/fb86ca9d-24d9-452e-b96d-e5638f5b5782 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:41:55.535418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:55.536243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:55.543452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.543882 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.544950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.545548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.644262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lazy-loading 'services' on Instance uuid eadf922d-e2cd-4805-9aee-7157bd242fa9 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:55.691370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:55.691989 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:55.720383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.720839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.723148 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.726387 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.786263 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c68ed49f-ac49-4c21-9352-5313af3d1cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments/fb86ca9d-24d9-452e-b96d-e5638f5b5782" status: 202 len: 0 microversion: 2.20 time: 0.255570 Jun 15 19:41:55.787628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 215/437] 10.222.0.15 () {60 vars in 1456 bytes} [Wed Jun 15 19:41:55 2022] DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments/fb86ca9d-24d9-452e-b96d-e5638f5b5782 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:41:55.841200 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:55.842874 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:55.874733 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.883180 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.884756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:55.886227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:55.943884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-32127c65-675b-4d96-baab-53eee778981e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121095 Jun 15 19:41:55.946497 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 216/438] 10.222.0.15 () {60 vars in 1342 bytes} [Wed Jun 15 19:41:55 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:41:55.988323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:56.006111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b0085b96-4137-46df-b47b-df98344fd2ff tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.318930 Jun 15 19:41:56.007832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 223/439] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:55 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:56.037142 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-9bc030e2-731b-4d80-a146-8a8841995204 req-1b4e9d1e-57c0-408c-b2c6-3b4c09051c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1dd930-31d9-48b7-a30e-28d7f7dc7378", "tag": "758322d5-263d-4d0a-87b4-7f197c2860e3"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:41:56.054663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-9bc030e2-731b-4d80-a146-8a8841995204 req-1b4e9d1e-57c0-408c-b2c6-3b4c09051c7e service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:56.055203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-9bc030e2-731b-4d80-a146-8a8841995204 req-1b4e9d1e-57c0-408c-b2c6-3b4c09051c7e service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:56.074125 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-9bc030e2-731b-4d80-a146-8a8841995204 req-1b4e9d1e-57c0-408c-b2c6-3b4c09051c7e service nova] Creating event network-changed:758322d5-263d-4d0a-87b4-7f197c2860e3 for instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 on hv-cinder-84456 Jun 15 19:41:56.080097 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-9bc030e2-731b-4d80-a146-8a8841995204 req-1b4e9d1e-57c0-408c-b2c6-3b4c09051c7e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048104 Jun 15 19:41:56.080715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 217/440] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:41:56.352135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:56.353275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:56.363589 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:56.364189 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:56.365369 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:56.366007 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:56.512193 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:56.519930 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ab3f07ac-99a8-4fe4-8e41-6bbd7052e762 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.182724 Jun 15 19:41:56.520499 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 224/441] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:56 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:56.959551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:56.961497 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:56.968883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:56.969330 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:56.970118 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:56.970554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:57.002919 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8d04c9d7-ecc0-4a09-9e24-0f049553133a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047737 Jun 15 19:41:57.003663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 218/442] 10.222.0.15 () {60 vars in 1342 bytes} [Wed Jun 15 19:41:56 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:41:57.026157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:57.026827 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:57.034331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:57.035275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:57.036134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:57.036645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:57.177943 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:57.186424 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-663242c1-36b5-4dd0-92fd-13ed862f12be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.165310 Jun 15 19:41:57.187141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 225/443] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:57 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:57.536727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:57.537364 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:57.543892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:57.544342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:57.545110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:57.545539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:57.691945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:57.699583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c305d02f-47a3-4b3b-a41c-8a521e2558be tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.166645 Jun 15 19:41:57.700142 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 219/444] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:57 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:58.016009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:58.017006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:58.023265 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.023714 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.024469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.024901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.054957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-970c4edf-d8e1-4926-ae56-424cb7f37cde tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042121 Jun 15 19:41:58.055761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 226/445] 10.222.0.15 () {60 vars in 1342 bytes} [Wed Jun 15 19:41:58 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:58.112128 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:58.112620 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:58.118790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.119237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.120000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.120432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.144840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:41:58.204402 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:58.205105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:58.207001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:58.207646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:58.214014 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.214499 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.215251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.215677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.226961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-862988b0-3a46-4f43-b95c-808f2c02cd6f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 204 len: 0 microversion: 2.20 time: 0.117681 Jun 15 19:41:58.227752 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 220/446] 10.222.0.15 () {60 vars in 1279 bytes} [Wed Jun 15 19:41:58 2022] DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 19:41:58.238014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:58.238776 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:58.245016 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.245460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.246256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.246957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.262503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=6 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:41:58.397344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:58.406647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b1d4917e-5577-4679-8c22-b494e0bb022b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.206061 Jun 15 19:41:58.408204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 227/447] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:58 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:41:58.426831 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:58.435301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:58.436796 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:58.437941 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6f34c1cb-d016-4b7f-948e-cfa93e8e0757 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.204713 Jun 15 19:41:58.438527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 221/448] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:58 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:41:58.717012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:58.717615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:58.723672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.724116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.724870 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:58.725299 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:58.861539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:58.870320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-06b29d1c-15e5-47e7-a33f-58e5c32b440c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.156982 Jun 15 19:41:58.870900 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 228/449] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:58 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:59.424830 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:59.425471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:59.433196 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.433642 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.434443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.434878 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.458049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:59.458687 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:59.465161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.465615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.466411 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.466844 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.628543 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:59.636532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b437083e-51dc-4b38-b115-86f19d456bf9 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.215634 Jun 15 19:41:59.637102 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 222/450] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:59 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:41:59.645646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:59.654377 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:59.655854 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:41:59.656992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1f0b33ad-e60c-4140-9f75-e4cfffb5bf99 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.202856 Jun 15 19:41:59.657541 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 229/451] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:41:59 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:41:59.724361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:59.724844 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:59.731472 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.731916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.732665 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.733092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.810964 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lazy-loading 'services' on Instance uuid 24f2e841-11f5-4b38-aa45-8a95492cec45 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:41:59.886663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-aa6e1821-0d31-4221-ab9a-6d4056ad4a48 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "DELETE /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45/os-volume_attachments/260382fa-e4ae-4592-a258-439615fb85fe" status: 202 len: 0 microversion: 2.1 time: 0.165755 Jun 15 19:41:59.887186 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 223/452] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:41:59 2022] DELETE /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45/os-volume_attachments/260382fa-e4ae-4592-a258-439615fb85fe => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:41:59.888966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:41:59.889592 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:41:59.897154 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.898159 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:41:59.899111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:41:59.899551 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:00.034926 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:00.042461 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bb79cd01-48f7-4bd0-88db-cdf699f83cfc tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.158742 Jun 15 19:42:00.043039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 230/453] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:41:59 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:00.655621 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:00.656444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:00.664059 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:00.664584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:00.665405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:00.665844 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:00.675646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:00.676256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:00.682988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:00.683441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:00.684220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:00.684652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:00.878524 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:00.886963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f4372d4f-4e92-49ef-a987-abd4bc94d50b tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.236230 Jun 15 19:42:00.890105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:00.891042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 224/454] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:00 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:00.899258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:00.901126 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:00.903439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1384e834-80fd-4a69-8dd2-99a7eced19f2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1724 microversion: 2.20 time: 0.230657 Jun 15 19:42:00.903439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 231/455] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:00 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:00.999435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:00.999926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:01.005915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.006591 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.007912 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.008340 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.012606 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:01.035337 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:42:01.059384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:01.060123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:01.067356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.068012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.069095 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.070277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.078522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=100 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:01.133702 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-566c7e7e-7e0b-42da-90e9-01f4d854396d tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "DELETE /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 204 len: 0 microversion: 2.1 time: 0.138298 Jun 15 19:42:01.134346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 225/456] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:42:00 2022] DELETE /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:42:01.143053 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:01.143750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:01.150005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.150902 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.151854 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.152445 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.266120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:01.278374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8fda8904-9ecb-404a-acd5-0a7b154298a9 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.222492 Jun 15 19:42:01.279920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 232/457] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:01 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:01.346796 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:01.357277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6824012b-67e8-4944-ba84-95d10a5d30fa tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1559 microversion: 2.1 time: 0.218357 Jun 15 19:42:01.358375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 226/458] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:01 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:01.400573 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-c537ed8c-4163-4a9f-9d4e-e7c5e095a569 req-89a9e7bd-64ce-473b-877a-759ce26dc9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadf922d-e2cd-4805-9aee-7157bd242fa9", "name": "network-vif-deleted", "tag": "e3f1f355-ef6f-4c67-8fc5-35f007612cd4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:01.419267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-c537ed8c-4163-4a9f-9d4e-e7c5e095a569 req-89a9e7bd-64ce-473b-877a-759ce26dc9c7 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.419604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-c537ed8c-4163-4a9f-9d4e-e7c5e095a569 req-89a9e7bd-64ce-473b-877a-759ce26dc9c7 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.433880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-c537ed8c-4163-4a9f-9d4e-e7c5e095a569 req-89a9e7bd-64ce-473b-877a-759ce26dc9c7 service nova] Creating event network-vif-deleted:e3f1f355-ef6f-4c67-8fc5-35f007612cd4 for instance eadf922d-e2cd-4805-9aee-7157bd242fa9 on hv-cinder-84456 Jun 15 19:42:01.439440 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-c537ed8c-4163-4a9f-9d4e-e7c5e095a569 req-89a9e7bd-64ce-473b-877a-759ce26dc9c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042779 Jun 15 19:42:01.444037 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 233/459] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:01.908005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:01.908605 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:01.915907 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.916410 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.917178 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.917637 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.923369 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:01.924062 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:01.930384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.930831 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.931679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.932425 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.964828 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:01.965510 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:01.966256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lazy-loading 'fault' on Instance uuid eadf922d-e2cd-4805-9aee-7157bd242fa9 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:42:02.027161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:02.040470 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:02.042174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:02.043619 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1af723e9-fa6e-4ef5-86bb-9ef605291382 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1372 microversion: 2.20 time: 0.125284 Jun 15 19:42:02.054628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 234/460] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:01 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1372 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:42:02.092222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:02.100253 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a5d5357a-40a1-4558-b5fb-5fbacb712110 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.196043 Jun 15 19:42:02.101481 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 227/461] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:01 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:02.295417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:02.296204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:02.302575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:02.303101 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:02.303930 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:02.304364 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:02.375429 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:02.376041 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:02.382891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:02.383689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:02.384477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:02.384913 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:02.479530 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:02.488150 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d5c26cb5-2b54-4cd3-8dee-c6c8e9726126 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.196452 Jun 15 19:42:02.488803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 235/462] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:02 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:02.542520 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:02.549905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1dcffb73-54d1-43c4-bda6-b56894c2a6a8 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1513 microversion: 2.1 time: 0.178650 Jun 15 19:42:02.550499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 228/463] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:02 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:03.061940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:03.062598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:03.069101 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.069552 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.070347 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.070777 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.102582 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.103024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.103888 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lazy-loading 'fault' on Instance uuid eadf922d-e2cd-4805-9aee-7157bd242fa9 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:42:03.119027 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:03.119633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:03.128534 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.128984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.129781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.130254 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.150239 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:03.159655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:03.161324 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:03.162526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-46f230fb-af11-4e4e-83a3-389e335b5746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 200 len: 1372 microversion: 2.20 time: 0.104452 Jun 15 19:42:03.164092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 236/464] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:03 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:03.281039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:03.289633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cfe2300f-1cb8-447c-a95c-5ab087fdb62d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.174976 Jun 15 19:42:03.290240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 229/465] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:03 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:03.348294 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-d63a55a0-246b-4320-97f2-68386bf307ca req-15568766-b104-4024-8c2e-3a7f19adf1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1dd930-31d9-48b7-a30e-28d7f7dc7378", "name": "network-vif-plugged", "status": "completed", "tag": "758322d5-263d-4d0a-87b4-7f197c2860e3"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:03.357018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-d63a55a0-246b-4320-97f2-68386bf307ca req-15568766-b104-4024-8c2e-3a7f19adf1d2 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.357469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-d63a55a0-246b-4320-97f2-68386bf307ca req-15568766-b104-4024-8c2e-3a7f19adf1d2 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.369350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-d63a55a0-246b-4320-97f2-68386bf307ca req-15568766-b104-4024-8c2e-3a7f19adf1d2 service nova] Creating event network-vif-plugged:758322d5-263d-4d0a-87b4-7f197c2860e3 for instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 on hv-cinder-84456 Jun 15 19:42:03.374461 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-d63a55a0-246b-4320-97f2-68386bf307ca req-15568766-b104-4024-8c2e-3a7f19adf1d2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 Jun 15 19:42:03.375284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 237/466] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:03.506082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:03.506743 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:03.512854 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.513305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.514110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.514582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.568199 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:03.569262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:03.581492 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.582384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.583382 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:03.584022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:03.731782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:03.739566 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f13e018e-5e23-4b2b-8687-33a971be146a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.237344 Jun 15 19:42:03.740144 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 230/467] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:03 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:03.761401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:03.769123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-01b5e80d-3a02-4d26-9993-208211cdfb25 tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1513 microversion: 2.1 time: 0.205402 Jun 15 19:42:03.769691 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 238/468] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:03 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:04.182349 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:04.182944 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:04.188930 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.189365 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.190166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.190594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.204938 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] HTTP exception thrown: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Request method failure captured: Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 HTTP/1.1 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUZegwmjrxP-P3u1YokawXWFb4q-AdLV5EafalPm7g8vA8vTtVNgmXoBrDsyCqLJnOt6uY5srHte-C1IDAsNhL3UxwK4Tt__V5frCnpqsSXxmS-1vndixjeX9A-scbE_43OOF9pRw9wpVmH_YEaZQVjdfLXoruuSo0ZpwF3lM05Jr4 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:42:04.206610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_71e0c71509f94f158063991e37617894", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/71e0c71509f94f158063991e37617894"}]}] Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: b2103a7ed6824444a60fa5573e7ad39e Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:42:04.208238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'eadf922d-e2cd-4805-9aee-7157bd242fa9'} Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:42:04.209028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:42:04.210386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:04.211471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Returning 404 to user: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:42:04.211471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0b7bd7ec-1676-4cf5-87dd-4ed5af7b509b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 404 len: 111 microversion: 2.20 time: 0.031404 Jun 15 19:42:04.211471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 231/469] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:04 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:42:04.217047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-643757ef-d947-4307-9650-bd2ae82cf320 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '.version_select at 0x7f16461861f0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:04.222863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:04.237419 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-643757ef-d947-4307-9650-bd2ae82cf320 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082348737" status: 204 len: 0 microversion: 2.20 time: 0.024268 Jun 15 19:42:04.238009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 239/470] 10.222.0.15 () {60 vars in 1261 bytes} [Wed Jun 15 19:42:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082348737 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 19:42:04.307837 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:04.308744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:04.310744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:04.316146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.316586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.317359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.317789 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.460526 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:04.469377 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-990dd382-d127-446a-8add-fcd7d2ffd76d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1732 microversion: 2.1 time: 0.165797 Jun 15 19:42:04.470635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 232/471] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:04 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:04.756952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:04.757578 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:04.763756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.764209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.765213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.765653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.786697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:04.787314 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:04.798155 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.798853 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.802533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.803041 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.914382 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:04.921922 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ea1828a2-25d2-43f4-9b3e-d6f4e4d3020a tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1471 microversion: 2.1 time: 0.138988 Jun 15 19:42:04.922583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 233/472] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:04 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1471 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:04.927483 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-c4aba980-6a34-4f04-80a3-5ac15059a252 req-fbfc55e2-7dd0-4a86-a5b0-dc9ca7509cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f2e841-11f5-4b38-aa45-8a95492cec45", "name": "network-vif-deleted", "tag": "cb276915-e785-4cf2-b1e5-e26ab501e7cc"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:04.935596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-c4aba980-6a34-4f04-80a3-5ac15059a252 req-fbfc55e2-7dd0-4a86-a5b0-dc9ca7509cb1 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:04.936038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-c4aba980-6a34-4f04-80a3-5ac15059a252 req-fbfc55e2-7dd0-4a86-a5b0-dc9ca7509cb1 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:04.947715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-c4aba980-6a34-4f04-80a3-5ac15059a252 req-fbfc55e2-7dd0-4a86-a5b0-dc9ca7509cb1 service nova] Creating event network-vif-deleted:cb276915-e785-4cf2-b1e5-e26ab501e7cc for instance 24f2e841-11f5-4b38-aa45-8a95492cec45 on hv-cinder-84456 Jun 15 19:42:04.952686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-c4aba980-6a34-4f04-80a3-5ac15059a252 req-fbfc55e2-7dd0-4a86-a5b0-dc9ca7509cb1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028989 Jun 15 19:42:04.953529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 234/473] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:04.983968 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:04.991964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-77df41bd-30a3-477f-a84c-b580d95350c7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.239090 Jun 15 19:42:04.998997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 240/474] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:04 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:05.166346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-14e8e4c1-0df3-48ae-bd2c-b1c1b28acc6e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'create', calling method: .version_select at 0x7f16458408b0>, body: {"keypair": {"name": "tempest-keypair-1193245966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdq9OmzBEHUnyBmOOUiHnu+rHbrNUCCLxzjdWu69ajAfwxxOqjttXd8lbKXKjg6vfDB0laOvjKA9Gzr4b0Sl/Ob9B//eCdGOztxLCfbMWwF9j8gkUGEvL9HioaDPxES0g=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:05.181323 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-14e8e4c1-0df3-48ae-bd2c-b1c1b28acc6e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for project 71e0c71509f94f158063991e37617894. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:42:05.185680 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-14e8e4c1-0df3-48ae-bd2c-b1c1b28acc6e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for user b2103a7ed6824444a60fa5573e7ad39e and project 71e0c71509f94f158063991e37617894. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:42:05.208553 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-14e8e4c1-0df3-48ae-bd2c-b1c1b28acc6e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046990 Jun 15 19:42:05.209187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 235/475] 10.222.0.15 () {62 vars in 1199 bytes} [Wed Jun 15 19:42:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 19:42:05.490933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:05.491639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:05.499189 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.499725 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.500598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.501111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.651505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:05.660151 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cb4503be-e15e-430c-8615-47d73b270a65 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1712 microversion: 2.1 time: 0.173954 Jun 15 19:42:05.660808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 241/476] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:05 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1712 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:05.768503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:05.769336 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:05.775896 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.776581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.777535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.778344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.878680 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] HTTP exception thrown: Cannot 'detach_volume' instance f4eda938-2478-4ddd-9f99-974f3ffe7123 while it is in vm_state rescued Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Request method failure captured: Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments/eb6ba6cd-d871-4f60-ab8d-1c920252a85f HTTP/1.1 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUbZ4qQjAiJYFrc8uCgnNNVTiUog9NrJ2Az8mjSYdHbZAr7Tmr4xQ3AtjSj3bma_7bsijzbaQazE9MmzaBOOmRXK8fi_RBQR_x9fyIgr_tq7YYj-IQ-JkoCC1eLyxHZifmpPwUL-ssx5ZgL1u4p31qBuGBMNqRFmexF6-sIYC732O8 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:42:05.881091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d5270cd64fd4929af7b063cf2e2b653", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d5270cd64fd4929af7b063cf2e2b653"}]}] Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f26a832b69564f2a8387215afba6730e Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:42:05.883240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Cannot 'detach_volume' instance f4eda938-2478-4ddd-9f99-974f3ffe7123 while it is in vm_state rescued Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'server_id': 'f4eda938-2478-4ddd-9f99-974f3ffe7123', 'id': 'eb6ba6cd-d871-4f60-ab8d-1c920252a85f'} Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:42:05.884005 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f4eda938-2478-4ddd-9f99-974f3ffe7123 while it is in vm_state rescued Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f4eda938-2478-4ddd-9f99-974f3ffe7123 while it is in vm_state rescued Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:05.885656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Returning 409 to user: Cannot 'detach_volume' instance f4eda938-2478-4ddd-9f99-974f3ffe7123 while it is in vm_state rescued {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:42:05.887128 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7002a59c-632d-480c-9cfc-2c73ae9dc5fe tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments/eb6ba6cd-d871-4f60-ab8d-1c920252a85f" status: 409 len: 152 microversion: 2.1 time: 0.120823 Jun 15 19:42:05.887128 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 236/477] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:42:05 2022] DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments/eb6ba6cd-d871-4f60-ab8d-1c920252a85f => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 19:42:05.895070 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:05.895601 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:05.901871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.902367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.903145 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.903759 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.943757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:05.944885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:05.953784 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.954763 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.956157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:05.956771 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:05.987244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-052a2e65-d596-4441-a500-40559a4bcce5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "POST /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/action" status: 202 len: 0 microversion: 2.1 time: 0.095815 Jun 15 19:42:05.987892 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:42:05 2022] POST /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 19:42:05.998566 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:06.000219 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:06.001815 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:06.002291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:06.002773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lazy-loading 'fault' on Instance uuid 24f2e841-11f5-4b38-aa45-8a95492cec45 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:42:06.007203 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:06.007661 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:06.008468 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:06.008901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:06.056206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6619b929f1844f48e0aa452ff5b8b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526f86dc251440b9b50e325de4efb751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:06.065248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b748476a-6aaa-408d-8dc5-fdc0f44e719f tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 200 len: 1309 microversion: 2.1 time: 0.128230 Jun 15 19:42:06.066496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 237/479] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:05 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:06.071941 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:06.072850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:06.081285 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:06.081729 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:06.082631 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:06.082992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:06.223526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:06.233695 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3239ff80-93da-450b-9836-998fdc8957c5 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1720 microversion: 2.1 time: 0.239645 Jun 15 19:42:06.235211 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 243/480] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:05 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:06.286883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:06.296649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-dc2b85a1-c812-49b4-9208-96b57be4974d tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1364 microversion: 2.1 time: 0.228635 Jun 15 19:42:06.297583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 238/481] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:06 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:06.868520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1612495103", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6ca100c-fdac-452a-ad9c-d280af0c139f"}], "security_groups": [{"name": "tempest-securitygroup--909326691"}], "key_name": "tempest-keypair-1193245966", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:06.980336 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] validate_networks() for [('f6ca100c-fdac-452a-ad9c-d280af0c139f', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:42:07.083558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:07.084259 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] [instance: 24f2e841-11f5-4b38-aa45-8a95492cec45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:07.090756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.091333 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.092143 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.092575 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.111416 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] HTTP exception thrown: Instance 24f2e841-11f5-4b38-aa45-8a95492cec45 could not be found. Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Request method failure captured: Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 HTTP/1.1 Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjWO13S6AL3Yj2MSQKkeL4a4h3_RkgOJ9aMStpi64tuL8JtjimNLS1RVXukjr4KYDa36cPTH9F7hJvnDDuRd5VP_h2St2tcXCtkzeWWsRLEQQSNatJxTQQwyLApTNCT4OeOE1cvkQuBukD5jfcRxHlm2d8vIIaNnCpMPTfujsAohoRc Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 526f86dc251440b9b50e325de4efb751 Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesSnapshotTestJSON-150526058 Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:42:07.113054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/526f86dc251440b9b50e325de4efb751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_526f86dc251440b9b50e325de4efb751", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/526f86dc251440b9b50e325de4efb751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/526f86dc251440b9b50e325de4efb751"}]}] Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesSnapshotTestJSON-150526058 Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 526f86dc251440b9b50e325de4efb751 Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-150526058 Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesSnapshotTestJSON-150526058-project Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: d6619b929f1844f48e0aa452ff5b8b51 Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesSnapshotTestJSON-150526058-project Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 24f2e841-11f5-4b38-aa45-8a95492cec45 could not be found. Jun 15 19:42:07.115007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '24f2e841-11f5-4b38-aa45-8a95492cec45'} Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f2e841-11f5-4b38-aa45-8a95492cec45 could not be found. Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:42:07.116204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f2e841-11f5-4b38-aa45-8a95492cec45 could not be found. Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f2e841-11f5-4b38-aa45-8a95492cec45 could not be found. Jun 15 19:42:07.117359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:07.118408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] Returning 404 to user: Instance 24f2e841-11f5-4b38-aa45-8a95492cec45 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:42:07.118408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c76b9664-482a-47d1-adc6-79c529594e9c tempest-VolumesSnapshotTestJSON-150526058 tempest-VolumesSnapshotTestJSON-150526058-project] 10.222.0.15 "GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45" status: 404 len: 111 microversion: 2.1 time: 0.034872 Jun 15 19:42:07.118408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 239/482] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:07 2022] GET /compute/v2.1/servers/24f2e841-11f5-4b38-aa45-8a95492cec45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:42:07.252983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:07.253680 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:07.261002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.261826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.262893 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.263400 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.561542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:07.578362 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7ff9879e-abf0-4ef7-a11c-a318e28cc931 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1720 microversion: 2.1 time: 0.328676 Jun 15 19:42:07.579639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 240/483] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:07 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:07.595437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:42:07.595437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:42:07.595437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:42:07.595437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:42:07.595437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:42:07.597770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.598213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.599297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.599975 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.605699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:07.606391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:07.617197 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.617663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.618587 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.619046 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.627041 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for project 71e0c71509f94f158063991e37617894. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:42:07.631841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Getting quotas for user b2103a7ed6824444a60fa5573e7ad39e and project 71e0c71509f94f158063991e37617894. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:42:07.657553 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:42:07.659952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:42:07.717296 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-35534196-842c-4e62-82a2-398dcd1712ea tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.852993 Jun 15 19:42:07.724972 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 244/484] 10.222.0.15 () {62 vars in 1187 bytes} [Wed Jun 15 19:42:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 15 19:42:07.731901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1319fadc-6c05-4ea2-8bfe-ad7d1acf2517 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:07.732508 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1319fadc-6c05-4ea2-8bfe-ad7d1acf2517 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:07.817738 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1319fadc-6c05-4ea2-8bfe-ad7d1acf2517 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:07.819291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:07.826649 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1319fadc-6c05-4ea2-8bfe-ad7d1acf2517 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:07.827983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1319fadc-6c05-4ea2-8bfe-ad7d1acf2517 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:07.830344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1319fadc-6c05-4ea2-8bfe-ad7d1acf2517 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1282 microversion: 2.20 time: 0.102616 Jun 15 19:42:07.830456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b6acadc0-9355-40c9-b0f3-538d19ae12d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1553 microversion: 2.1 time: 0.228408 Jun 15 19:42:07.837320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 241/485] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:07 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:07.837464 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 245/486] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:07 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:07.847929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:07.848666 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:07.855601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.856107 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.856993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:07.857500 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:07.944599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-af0d804d-9417-4ee5-ba1e-c80b59545a02 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100448 Jun 15 19:42:07.945446 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 242/487] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:42:07 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:08.602667 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:08.604005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:08.611007 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:08.611685 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:08.612466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:08.612899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:08.788596 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:08.796915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-508c0b18-f055-4c5b-85ae-02ca7710771e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1720 microversion: 2.1 time: 0.197928 Jun 15 19:42:08.797488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 246/488] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:08 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:08.847726 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:08.848918 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:08.856139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:08.856827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:08.857760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:08.858416 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:08.864134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:08.910466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-e316da5a-75d0-4e73-bb3c-8611958bfb6d req-d0266375-5379-4536-bb7d-a060e1d25123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1dd930-31d9-48b7-a30e-28d7f7dc7378", "tag": "758322d5-263d-4d0a-87b4-7f197c2860e3"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:08.919874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-e316da5a-75d0-4e73-bb3c-8611958bfb6d req-d0266375-5379-4536-bb7d-a060e1d25123 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:08.920657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-e316da5a-75d0-4e73-bb3c-8611958bfb6d req-d0266375-5379-4536-bb7d-a060e1d25123 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:08.931860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:08.933679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-e316da5a-75d0-4e73-bb3c-8611958bfb6d req-d0266375-5379-4536-bb7d-a060e1d25123 service nova] Creating event network-changed:758322d5-263d-4d0a-87b4-7f197c2860e3 for instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 on hv-cinder-84456 Jun 15 19:42:08.940001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-e316da5a-75d0-4e73-bb3c-8611958bfb6d req-d0266375-5379-4536-bb7d-a060e1d25123 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Jun 15 19:42:08.941233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 247/489] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:08.941488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:08.943513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:08.945394 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b328585f-ce82-40f4-9fae-bac0ad3f8797 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1286 microversion: 2.20 time: 0.101775 Jun 15 19:42:08.956196 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 243/490] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:08 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:09.816100 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:09.817307 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:09.827572 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:09.828115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:09.829258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:09.829760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:09.968679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:09.969614 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:09.984525 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:09.985302 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:09.986437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:09.987075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:09.997623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:10.011341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9d06681d-c920-4c57-b099-c33647ceaa0a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1720 microversion: 2.1 time: 0.199636 Jun 15 19:42:10.012342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 248/491] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:09 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:10.077444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:10.090545 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:10.093266 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:10.094772 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c01b620f-0d2a-471c-a218-56f8daf57e55 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1334 microversion: 2.20 time: 0.134038 Jun 15 19:42:10.102566 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 244/492] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:09 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1334 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:11.034735 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:11.035352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:11.041902 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:11.042370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:11.043133 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:11.043564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:11.118891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:11.119495 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:11.127114 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:11.127564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:11.128339 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:11.128768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:11.208880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:11.214005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:11.218594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:11.220208 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:11.221359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b9ed85b6-4e3c-40cb-8972-db42f6977239 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1334 microversion: 2.20 time: 0.106994 Jun 15 19:42:11.221926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 245/493] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:11 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:42:11.223480 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7717e215-2585-4343-81b7-6afae3f7bf4f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1720 microversion: 2.1 time: 0.192601 Jun 15 19:42:11.224212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 249/494] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:11 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:12.241179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:12.241781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:12.243815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:12.245064 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:12.250164 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:12.250612 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:12.251407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:12.251809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:12.252872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:12.253398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:12.254275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:12.254793 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:12.322724 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:12.330818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:12.332320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:12.333447 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0f191efc-6b93-47f9-92e8-dadecaa111ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1342 microversion: 2.20 time: 0.096843 Jun 15 19:42:12.334006 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 246/495] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:12 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:12.411401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:12.421672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-19a8da74-e0d9-48e1-8325-0806928432be tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1726 microversion: 2.1 time: 0.184352 Jun 15 19:42:12.422555 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 250/496] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:12 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:12.440046 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:12.440531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:12.449435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:12.450131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:12.451069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:12.451615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:12.536024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b7f85134-541e-4071-b6ed-83b557fe4797 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100783 Jun 15 19:42:12.538121 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 247/497] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:42:12 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:13.352215 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:13.352891 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:13.364799 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:13.366481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:13.367580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:13.368575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:13.621903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:13.625831 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:13.631515 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:13.633522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:13.634705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-fe77e247-99e4-4d91-ac6f-418a1397c642 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.287040 Jun 15 19:42:13.635845 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 251/498] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:13 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:13.836356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-2338ae28-216f-4de2-8cf1-24a528bc225d req-64c9ca2c-5970-4a5e-833f-9b8e255845c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4eda938-2478-4ddd-9f99-974f3ffe7123", "tag": "a87c9c4f-dbec-4c55-a398-b538509f41ea"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:13.847886 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-2338ae28-216f-4de2-8cf1-24a528bc225d req-64c9ca2c-5970-4a5e-833f-9b8e255845c7 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:13.848637 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-2338ae28-216f-4de2-8cf1-24a528bc225d req-64c9ca2c-5970-4a5e-833f-9b8e255845c7 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:13.862457 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-2338ae28-216f-4de2-8cf1-24a528bc225d req-64c9ca2c-5970-4a5e-833f-9b8e255845c7 service nova] Creating event network-changed:a87c9c4f-dbec-4c55-a398-b538509f41ea for instance f4eda938-2478-4ddd-9f99-974f3ffe7123 on hv-cinder-84456 Jun 15 19:42:13.868231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-2338ae28-216f-4de2-8cf1-24a528bc225d req-64c9ca2c-5970-4a5e-833f-9b8e255845c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036000 Jun 15 19:42:13.869292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 248/499] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:14.660402 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:14.662998 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:14.679588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:14.680659 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:14.681702 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:14.682737 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:14.878288 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-992084ea-4cb4-431b-8856-00a19867fde8 req-e85f4ba7-74d5-4b7b-9d50-cc89b2adc0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:14.914066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:14.917469 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-992084ea-4cb4-431b-8856-00a19867fde8 req-e85f4ba7-74d5-4b7b-9d50-cc89b2adc0dc service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:14.920344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-992084ea-4cb4-431b-8856-00a19867fde8 req-e85f4ba7-74d5-4b7b-9d50-cc89b2adc0dc service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:14.925963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:14.934882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:14.936404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-61a3101b-76b9-4667-8c77-379b3b5d00f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.286605 Jun 15 19:42:14.937684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 252/500] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:14 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:14.954490 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-992084ea-4cb4-431b-8856-00a19867fde8 req-e85f4ba7-74d5-4b7b-9d50-cc89b2adc0dc service nova] Creating event network-changed:e86b7374-75c4-418c-9797-1366945e2805 for instance 29d61603-5469-4233-b4a1-95259f1fc06b on hv-cinder-84456 Jun 15 19:42:14.970477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-992084ea-4cb4-431b-8856-00a19867fde8 req-e85f4ba7-74d5-4b7b-9d50-cc89b2adc0dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111004 Jun 15 19:42:14.983028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 249/501] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:15.884979 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-f2193dac-f92d-45e2-810b-7f2b7c513ca1 req-d328048d-0fe3-49f4-9d29-e47ccc18ff9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4eda938-2478-4ddd-9f99-974f3ffe7123", "tag": "a87c9c4f-dbec-4c55-a398-b538509f41ea"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:15.894050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-f2193dac-f92d-45e2-810b-7f2b7c513ca1 req-d328048d-0fe3-49f4-9d29-e47ccc18ff9c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:15.894533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-f2193dac-f92d-45e2-810b-7f2b7c513ca1 req-d328048d-0fe3-49f4-9d29-e47ccc18ff9c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:15.906894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-f2193dac-f92d-45e2-810b-7f2b7c513ca1 req-d328048d-0fe3-49f4-9d29-e47ccc18ff9c service nova] Creating event network-changed:a87c9c4f-dbec-4c55-a398-b538509f41ea for instance f4eda938-2478-4ddd-9f99-974f3ffe7123 on hv-cinder-84456 Jun 15 19:42:15.911948 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-f2193dac-f92d-45e2-810b-7f2b7c513ca1 req-d328048d-0fe3-49f4-9d29-e47ccc18ff9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031345 Jun 15 19:42:15.912572 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 253/502] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:15.961565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=4 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:15.967105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:15.967842 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:15.975293 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:15.975727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:15.976496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:15.976926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:16.135922 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:16.144685 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:16.146227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:16.147368 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-32bf24d0-bb90-44d6-b46e-7bb6f32bc543 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.186924 Jun 15 19:42:16.147940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 250/503] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:15 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:17.165994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:17.166725 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:17.173700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:17.174177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:17.174954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:17.175417 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:17.311288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:17.320077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:17.321574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:17.322694 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-28179912-af78-4d6c-b889-439b15ae9098 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.161669 Jun 15 19:42:17.323240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 254/504] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:17 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:18.341962 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:18.343488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:18.350126 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:18.351325 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:18.352918 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:18.353559 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:18.495507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:18.505648 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:18.507217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:18.508341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-04b36209-3c51-4bc6-8273-75e1fa8112b1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.171014 Jun 15 19:42:18.508928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 251/505] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:18 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:19.527953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:19.528574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:19.530797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:19.531528 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=8 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:19.538912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:19.539359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:19.540129 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:19.540562 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:19.714936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:19.723202 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:19.724702 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:19.726333 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-683e97cf-06e0-4603-9767-2c6b4c394af0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.204034 Jun 15 19:42:19.727009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 255/506] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:19 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:20.744903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:20.745537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:20.752277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:20.752723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:20.753484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:20.753916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:20.892682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:20.900741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:20.902491 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:20.903803 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c38d99c1-3a5f-4e1e-bc58-27aefdfecfa5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.163298 Jun 15 19:42:20.904435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 252/507] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:20 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:21.385025 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-8ae49f79-c277-497a-b613-deed7c6efae7 req-22e4e2eb-93d7-4300-b05b-5e387fd644eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "name": "network-vif-plugged", "status": "completed", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:21.394340 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-8ae49f79-c277-497a-b613-deed7c6efae7 req-22e4e2eb-93d7-4300-b05b-5e387fd644eb service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:21.394798 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-8ae49f79-c277-497a-b613-deed7c6efae7 req-22e4e2eb-93d7-4300-b05b-5e387fd644eb service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:21.406701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-8ae49f79-c277-497a-b613-deed7c6efae7 req-22e4e2eb-93d7-4300-b05b-5e387fd644eb service nova] Creating event network-vif-plugged:e86b7374-75c4-418c-9797-1366945e2805 for instance 29d61603-5469-4233-b4a1-95259f1fc06b on hv-cinder-84456 Jun 15 19:42:21.411829 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-8ae49f79-c277-497a-b613-deed7c6efae7 req-22e4e2eb-93d7-4300-b05b-5e387fd644eb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030551 Jun 15 19:42:21.412424 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 256/508] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:21.922491 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:21.923100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:21.930757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:21.931532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:21.932904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:21.933583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:22.082351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:22.091430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:22.093010 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:22.094344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-255655cc-58d1-4868-852a-b7ba926fbc52 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.176007 Jun 15 19:42:22.095017 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 253/509] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:21 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:23.113780 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:23.114649 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:23.121457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:23.121938 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:23.122732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:23.123165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:23.263919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:23.272551 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:23.274075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:23.275220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cc94b0cf-701f-4915-b7b6-941725c5293b tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1407 microversion: 2.20 time: 0.166199 Jun 15 19:42:23.275780 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 257/510] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:23 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:24.293210 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:24.293852 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:24.301161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:24.301721 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:24.302960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:24.303485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:24.452085 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:24.460675 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:24.462180 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:24.463320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a0254579-b325-4caa-ac4d-dddcbd0a0cf0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1600 microversion: 2.20 time: 0.173957 Jun 15 19:42:24.463870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 254/511] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:42:24 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:42:24.482268 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:24.482788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:24.489111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:24.489561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:24.490362 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:24.490933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:24.572003 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5c38c664-8168-4e1d-8fae-7ab9300df4d0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094007 Jun 15 19:42:24.572608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 258/512] 10.222.0.15 () {60 vars in 1315 bytes} [Wed Jun 15 19:42:24 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:42:25.593633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-35115715-afcd-4c32-9f85-1fa70412f50a req-35c706c4-4274-4a79-ba41-abe55dac07fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:25.603687 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-35115715-afcd-4c32-9f85-1fa70412f50a req-35c706c4-4274-4a79-ba41-abe55dac07fc service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:25.604261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-35115715-afcd-4c32-9f85-1fa70412f50a req-35c706c4-4274-4a79-ba41-abe55dac07fc service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:25.616373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-35115715-afcd-4c32-9f85-1fa70412f50a req-35c706c4-4274-4a79-ba41-abe55dac07fc service nova] Creating event network-changed:e86b7374-75c4-418c-9797-1366945e2805 for instance 29d61603-5469-4233-b4a1-95259f1fc06b on hv-cinder-84456 Jun 15 19:42:25.622003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-35115715-afcd-4c32-9f85-1fa70412f50a req-35c706c4-4274-4a79-ba41-abe55dac07fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032097 Jun 15 19:42:25.622630 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 255/513] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:35.492052 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:35.492810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=32 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:35.497305 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:35.498280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:35.505580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:35.506557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:35.507328 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:35.507763 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:35.539416 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a077499a-aeab-460f-86fd-b3e95b70026c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048946 Jun 15 19:42:35.540020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 259/514] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:42:35 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:42:35.598780 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:35.599396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:35.601283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:35.606785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:35.607234 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:35.607998 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:35.608432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:35.609344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=62 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:35.636359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:42:35.712948 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a1635286-bd27-480b-9d30-51c2de7f9c40 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 204 len: 0 microversion: 2.1 time: 0.118884 Jun 15 19:42:35.713684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 256/515] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:42:35 2022] DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:42:35.721982 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:35.722754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:35.729159 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:35.729609 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:35.730404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:35.730839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:35.864831 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:35.873207 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ec96cf1f-3ee8-4c01-a696-d20c05c629b5 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1674 microversion: 2.1 time: 0.155061 Jun 15 19:42:35.873766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 260/516] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:35 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:36.891516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:36.892118 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:36.899274 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:36.899713 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:36.900461 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:36.901130 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:37.033824 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:37.041499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cfa6d14c-f249-4eb2-a3ce-eada5aa96d0a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1674 microversion: 2.1 time: 0.154220 Jun 15 19:42:37.042062 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 257/517] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:36 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:38.058628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:38.059165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:38.065747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:38.066233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:38.067059 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:38.067588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:38.202607 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:38.210877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a2641284-0a0d-4fd4-95c3-ffb667bd2642 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1674 microversion: 2.1 time: 0.156123 Jun 15 19:42:38.211490 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 261/518] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:38 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:39.122871 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-4579e884-1d96-4266-b3f4-08d6576d2851 req-8d53d5a3-18d7-4f30-98a0-c20d709868b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a4ed60-945d-46a9-8f53-ead05148049e", "name": "network-vif-deleted", "tag": "957e70e2-59d5-4a89-bd25-2ddff5525782"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:39.132746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-4579e884-1d96-4266-b3f4-08d6576d2851 req-8d53d5a3-18d7-4f30-98a0-c20d709868b8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:39.133442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-4579e884-1d96-4266-b3f4-08d6576d2851 req-8d53d5a3-18d7-4f30-98a0-c20d709868b8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:39.145516 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-4579e884-1d96-4266-b3f4-08d6576d2851 req-8d53d5a3-18d7-4f30-98a0-c20d709868b8 service nova] Creating event network-vif-deleted:957e70e2-59d5-4a89-bd25-2ddff5525782 for instance b7a4ed60-945d-46a9-8f53-ead05148049e on hv-cinder-84456 Jun 15 19:42:39.151249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-4579e884-1d96-4266-b3f4-08d6576d2851 req-8d53d5a3-18d7-4f30-98a0-c20d709868b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Jun 15 19:42:39.152462 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 258/519] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:42:39.229416 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:39.230030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:39.237340 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:39.237797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:39.238674 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:39.239106 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:39.307412 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:39.315411 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b9e5f425-4924-4f3e-9500-3c2ed4188d0f tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 200 len: 1323 microversion: 2.1 time: 0.089954 Jun 15 19:42:39.315987 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 262/520] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:39 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 1323 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:40.333482 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:40.334204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:40.340653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:40.341101 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:40.341872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:40.342340 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:40.355594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] HTTP exception thrown: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Request method failure captured: Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e HTTP/1.1 Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUTWWUQy2Qmr7y3ureEv8K8Qqjy7RLDUcG2HY8Ah7zgpS90vp-9FL6MHvjvIXu6NSiGBOMa0kEiXwviQ6Fgmfrcp2mYFaXPigTdGC_9yGSXbeXXMCVgiEmMVGYk_t_ADQdTr-syfyohDPcu-vvmMRxeIdJjk57lqUBwkxKmToosgJE Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:42:40.357201 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd64a4f6222542f19ba5729f7abe12b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd64a4f6222542f19ba5729f7abe12b2"}]}] Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: c815423179f44b219e4f8572b10355c0 Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:42:40.358832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'b7a4ed60-945d-46a9-8f53-ead05148049e'} Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:42:40.359846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:42:40.361331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:40.363154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Returning 404 to user: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:42:40.363154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-03f2ffc7-cafe-433f-bbce-eddc8718e15c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 404 len: 111 microversion: 2.1 time: 0.029891 Jun 15 19:42:40.363154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 259/521] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:40 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:42:40.368014 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-90670758-046d-4519-88e6-a8dbe25dfba9 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '.version_select at 0x7f164590d4c0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:40.385642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-90670758-046d-4519-88e6-a8dbe25dfba9 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045709903" status: 202 len: 0 microversion: 2.1 time: 0.021997 Jun 15 19:42:40.386225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 263/522] 10.222.0.15 () {58 vars in 1220 bytes} [Wed Jun 15 19:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045709903 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:42:40.982871 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-db7f101c-73a1-4f72-8cef-7c1e3b8412ed tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: .version_select at 0x7f1645806040>, body: {"keypair": {"name": "tempest-keypair-1094255104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSmoZisPdqi+Z81BgI4Dueb2h7mkc9k6j63vSOLrW2emI3/HgKNDfk35Fi0B1pSXC9HTrYGtc0q+htMr9DHIjW4ufJuFW83trtI0kJGNJ6Pg86TgV5K2RrTpptttuQSA=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:40.998057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-db7f101c-73a1-4f72-8cef-7c1e3b8412ed tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:42:41.002407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-db7f101c-73a1-4f72-8cef-7c1e3b8412ed tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for user c815423179f44b219e4f8572b10355c0 and project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:42:41.025243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-db7f101c-73a1-4f72-8cef-7c1e3b8412ed tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046167 Jun 15 19:42:41.025840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 260/523] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:42:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:42.244422 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1876474003", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68dc56fb-2946-4967-bb27-7b13a758ce58"}], "security_groups": [{"name": "tempest-securitygroup--1451888977"}], "key_name": "tempest-keypair-1094255104", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:42.348137 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] validate_networks() for [('68dc56fb-2946-4967-bb27-7b13a758ce58', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:42:42.918208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:42:42.918635 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:42:42.919136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:42:42.919545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:42:42.919985 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:42:42.928884 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:42.929333 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:42.930331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:42.930602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:42.947626 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:42:42.951551 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Getting quotas for user c815423179f44b219e4f8572b10355c0 and project bd64a4f6222542f19ba5729f7abe12b2. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:42:42.963509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:42:42.965767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:42:43.011513 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-93cce811-2f73-4df1-8232-da295d170197 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.772640 Jun 15 19:42:43.012161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 264/524] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:42:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:42:43.023547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-405f1e3a-c69e-4dee-8686-cc33d2af0699 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:43.024297 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-405f1e3a-c69e-4dee-8686-cc33d2af0699 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:43.078943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-405f1e3a-c69e-4dee-8686-cc33d2af0699 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:43.085779 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-405f1e3a-c69e-4dee-8686-cc33d2af0699 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1238 microversion: 2.1 time: 0.067427 Jun 15 19:42:43.086397 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 261/525] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:43 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:44.104529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:44.105579 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:44.112489 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:44.113230 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:44.113703 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:44.114159 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:44.176571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:44.187581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-2cf13297-5587-4f55-a78a-c3c03d7b0f52 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1296 microversion: 2.1 time: 0.088777 Jun 15 19:42:44.188302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 265/526] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:44 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:45.206145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:45.207179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:45.216272 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:45.217089 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:45.218021 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:45.219217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:45.369284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-13d7b712-9a20-405f-a956-788dfa40621f req-a9474e45-a586-4017-aff1-2c22f769c791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84adebc2-eb18-4ae1-ad7f-a36c741aae45", "tag": "121b09fa-9774-40f8-9410-bc5765d4bce1"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:45.378245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-13d7b712-9a20-405f-a956-788dfa40621f req-a9474e45-a586-4017-aff1-2c22f769c791 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:45.378682 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-13d7b712-9a20-405f-a956-788dfa40621f req-a9474e45-a586-4017-aff1-2c22f769c791 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:45.421271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-13d7b712-9a20-405f-a956-788dfa40621f req-a9474e45-a586-4017-aff1-2c22f769c791 service nova] Creating event network-changed:121b09fa-9774-40f8-9410-bc5765d4bce1 for instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 on hv-cinder-84456 Jun 15 19:42:45.441792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:45.450166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-13d7b712-9a20-405f-a956-788dfa40621f req-a9474e45-a586-4017-aff1-2c22f769c791 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082080 Jun 15 19:42:45.451260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 266/527] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:42:45.462900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-56eecc7e-4316-45a6-afa3-8db0fdffb44e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.260493 Jun 15 19:42:45.464336 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 262/528] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:45 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:46.473077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:46.473994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:46.484747 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:46.485702 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:46.485978 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:46.486251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:46.487019 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:46.487464 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:46.494846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:46.495394 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:46.496550 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:46.497055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:46.655675 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:46.663273 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-04629ec9-69d3-42f3-b04d-692f54477bbc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.182490 Jun 15 19:42:46.663843 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 263/529] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:46 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:46.855939 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'services' on Instance uuid f4eda938-2478-4ddd-9f99-974f3ffe7123 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:42:46.981894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-be4ef612-99bc-4885-ab20-aabd9f9f96c8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments/eb6ba6cd-d871-4f60-ab8d-1c920252a85f" status: 202 len: 0 microversion: 2.1 time: 0.515778 Jun 15 19:42:46.982537 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 267/530] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:42:46 2022] DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments/eb6ba6cd-d871-4f60-ab8d-1c920252a85f => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:42:46.991605 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:46.992775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:47.000939 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:47.001389 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:47.002195 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:47.002636 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:47.038332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-177d8217-815c-4c53-b9b4-bfdb916e6b1a tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051219 Jun 15 19:42:47.038911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 264/531] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:42:46 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:47.682312 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:47.683227 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:47.690077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:47.690558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:47.691337 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:47.691951 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:47.846888 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:47.855438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0e08ba56-771c-4a9d-9a61-5e4534674922 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.178438 Jun 15 19:42:47.856109 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 268/532] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:47 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:48.055898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:48.057452 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:48.066227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.066676 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.067453 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.067880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.104307 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3f6263a1-8fbf-4a58-a973-c9900e1fb4e2 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055908 Jun 15 19:42:48.104790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 265/533] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:42:48 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:42:48.197014 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:48.197774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:48.206700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.207373 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.209113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.209755 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.250954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:42:48.356187 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a804ab5f-4b02-4519-88b2-ca4db5f31768 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 204 len: 0 microversion: 2.1 time: 0.165482 Jun 15 19:42:48.357190 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 269/534] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:42:48 2022] DELETE /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:42:48.367853 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:48.368523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:48.376361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.376898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.377735 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.378190 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.526409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:48.534846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5df65217-215e-4898-9b23-e63184db18ec tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1686 microversion: 2.1 time: 0.171577 Jun 15 19:42:48.535421 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 266/535] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:48 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:48.876097 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:48.876814 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:48.883670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.884122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:48.884899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:48.885358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:49.029792 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:49.040764 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cfa5ab8a-cf39-4363-806f-a98184eacedc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.168731 Jun 15 19:42:49.041608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 270/536] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:48 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:49.551847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:49.553179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:49.560187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:49.560635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:49.561403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:49.561828 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:49.814836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:49.822935 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9f1d96cd-5b90-4206-a47d-b5294c5519d7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1686 microversion: 2.1 time: 0.274897 Jun 15 19:42:49.823792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 267/537] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:49 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1686 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:50.059233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:50.059839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:50.066486 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:50.066934 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:50.068288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:50.068719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:50.211930 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:50.219748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c9a5ae59-ebe7-4216-bd04-e1e108693228 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.164856 Jun 15 19:42:50.220330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 271/538] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:50 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:50.840468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:50.841066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:50.848044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:50.848500 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:50.849891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:50.850352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:50.990223 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:50.999189 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bfbb101f-cce1-4b4e-a97e-70edb86b611e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1686 microversion: 2.1 time: 0.162593 Jun 15 19:42:50.999775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 268/539] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:50 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:51.236877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:51.237473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:51.244724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:51.245172 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:51.246226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:51.246690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:51.395957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:51.406942 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-27667a30-9fb4-442c-b630-e55fd930a4f0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.173405 Jun 15 19:42:51.407986 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 272/540] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:51 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:51.523176 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-f6ddd8c2-fa53-4b90-a08c-1f1d06ef12aa req-c05b247a-e454-478e-aeee-47e868489cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84adebc2-eb18-4ae1-ad7f-a36c741aae45", "name": "network-vif-plugged", "status": "completed", "tag": "121b09fa-9774-40f8-9410-bc5765d4bce1"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:51.535977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-f6ddd8c2-fa53-4b90-a08c-1f1d06ef12aa req-c05b247a-e454-478e-aeee-47e868489cb5 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:51.538041 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-f6ddd8c2-fa53-4b90-a08c-1f1d06ef12aa req-c05b247a-e454-478e-aeee-47e868489cb5 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:51.559938 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-f6ddd8c2-fa53-4b90-a08c-1f1d06ef12aa req-c05b247a-e454-478e-aeee-47e868489cb5 service nova] Creating event network-vif-plugged:121b09fa-9774-40f8-9410-bc5765d4bce1 for instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 on hv-cinder-84456 Jun 15 19:42:51.570220 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-f6ddd8c2-fa53-4b90-a08c-1f1d06ef12aa req-c05b247a-e454-478e-aeee-47e868489cb5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050801 Jun 15 19:42:51.571424 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 269/541] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:52.016956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:52.017575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:52.025242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:52.025894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:52.026781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:52.027222 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:52.167250 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:52.175228 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-11804e0e-8091-4918-9123-a9f3557fe099 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1686 microversion: 2.1 time: 0.162172 Jun 15 19:42:52.175804 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 273/542] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:52 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:52.369359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:52.371314 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:52.387317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:52.388081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:52.391472 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:52.392043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:52.421067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f6416d38-dd16-4f9c-87cc-337fa41e4a98 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/ips" status: 200 len: 148 microversion: 2.1 time: 0.060010 Jun 15 19:42:52.430410 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 270/543] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:42:52 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/ips => generated 148 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:52.435672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:52.436352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:52.454227 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:52.454781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:52.456077 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:52.457034 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:52.665309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:52.682989 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e816012f-abec-47c1-ab64-700e73dd7feb tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.253417 Jun 15 19:42:52.684000 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 274/544] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:52 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:53.193673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:53.194450 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:53.196628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=6 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:53.202301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.202781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.203822 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.204291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.273945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:53.283833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-94b263b5-bc33-4041-9087-c26022418d63 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1619 microversion: 2.1 time: 0.094400 Jun 15 19:42:53.284770 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 271/545] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:53 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1619 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:53.397899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-699d0d8d-83ea-4b5a-992a-262c82ae3a77 req-094ed861-d914-4bec-a70e-80369e2e718e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4eda938-2478-4ddd-9f99-974f3ffe7123", "name": "network-vif-deleted", "tag": "a87c9c4f-dbec-4c55-a398-b538509f41ea"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:53.402173 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:53.403006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:53.411313 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-699d0d8d-83ea-4b5a-992a-262c82ae3a77 req-094ed861-d914-4bec-a70e-80369e2e718e service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.411761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-699d0d8d-83ea-4b5a-992a-262c82ae3a77 req-094ed861-d914-4bec-a70e-80369e2e718e service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.425651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-699d0d8d-83ea-4b5a-992a-262c82ae3a77 req-094ed861-d914-4bec-a70e-80369e2e718e service nova] Creating event network-vif-deleted:a87c9c4f-dbec-4c55-a398-b538509f41ea for instance f4eda938-2478-4ddd-9f99-974f3ffe7123 on hv-cinder-84456 Jun 15 19:42:53.431560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-699d0d8d-83ea-4b5a-992a-262c82ae3a77 req-094ed861-d914-4bec-a70e-80369e2e718e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037827 Jun 15 19:42:53.432166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 275/546] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:53.705893 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:53.706748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:53.715953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.716721 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.718066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.718768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.871579 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155cac21-746d-4119-be07-fe1fd8182696"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:53.874319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:53.883768 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.884639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.886244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:53.887197 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:53.894952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:53.899804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:53.908229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-70ead4fb-ecd8-47ac-b13b-05027d8499c1 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1364 microversion: 2.1 time: 0.208474 Jun 15 19:42:53.908960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 272/547] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:53 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:54.304850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:54.305588 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:54.312347 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:54.312790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:54.313564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:54.313999 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:54.356728 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:54.357285 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:54.358059 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'fault' on Instance uuid f4eda938-2478-4ddd-9f99-974f3ffe7123 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:42:54.411760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:54.420444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-603d57b4-6a4e-47c4-9ad5-e55228906ff6 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 200 len: 1333 microversion: 2.1 time: 0.119400 Jun 15 19:42:54.421486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 273/548] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:54 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:42:54.682826 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bd430781-d52b-4d4a-a07b-65e14b4f06c5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818465 Jun 15 19:42:54.683545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 276/549] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:42:53 2022] POST /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:54.927982 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:54.928611 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:54.936688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:54.937414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:54.938403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:54.938877 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:55.092948 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:55.096404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:42:55.102235 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-21a41a5d-4b5b-4454-9357-ade5e3321615 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1551 microversion: 2.1 time: 0.179705 Jun 15 19:42:55.102818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 274/550] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:54 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1551 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:55.122771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:55.123572 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:55.132599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:55.133250 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:55.134382 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:55.135024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:55.243545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c4531c88-bd31-4566-a66d-79c3df6b2781 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128227 Jun 15 19:42:55.244492 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 277/551] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:42:55 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:55.444054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:55.444679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: f4eda938-2478-4ddd-9f99-974f3ffe7123] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:55.452265 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:55.452759 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:55.453533 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:55.453980 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:55.470270 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] HTTP exception thrown: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 could not be found. Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Request method failure captured: Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 HTTP/1.1 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUbZ4qQjAiJYFrc8uCgnNNVTiUog9NrJ2Az8mjSYdHbZAr7Tmr4xQ3AtjSj3bma_7bsijzbaQazE9MmzaBOOmRXK8fi_RBQR_x9fyIgr_tq7YYj-IQ-JkoCC1eLyxHZifmpPwUL-ssx5ZgL1u4p31qBuGBMNqRFmexF6-sIYC732O8 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:42:55.471940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d5270cd64fd4929af7b063cf2e2b653", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d5270cd64fd4929af7b063cf2e2b653"}]}] Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f26a832b69564f2a8387215afba6730e Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 could not be found. Jun 15 19:42:55.473488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'f4eda938-2478-4ddd-9f99-974f3ffe7123'} Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 could not be found. Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:42:55.474518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 could not be found. Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 could not be found. Jun 15 19:42:55.475892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:42:55.477084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Returning 404 to user: Instance f4eda938-2478-4ddd-9f99-974f3ffe7123 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:42:55.477084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8348d05d-c4d8-4de3-9992-bfbc8b9da751 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123" status: 404 len: 111 microversion: 2.1 time: 0.033879 Jun 15 19:42:55.477084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 275/552] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:55 2022] GET /compute/v2.1/servers/f4eda938-2478-4ddd-9f99-974f3ffe7123 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:42:55.482871 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-01cd7599-b56c-4471-be79-b6944b50f8b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '.version_select at 0x7f16461b4550>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:55.502714 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-01cd7599-b56c-4471-be79-b6944b50f8b0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596616471" status: 202 len: 0 microversion: 2.1 time: 0.023940 Jun 15 19:42:55.504221 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 278/553] 10.222.0.15 () {58 vars in 1217 bytes} [Wed Jun 15 19:42:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596616471 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:42:56.496263 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-aed6fe4d-8a70-4f93-bc5e-ad355b8bb92e req-f577855a-5ab5-41fb-adc8-c0af5ac653a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84adebc2-eb18-4ae1-ad7f-a36c741aae45", "tag": "121b09fa-9774-40f8-9410-bc5765d4bce1"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:42:56.507684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-aed6fe4d-8a70-4f93-bc5e-ad355b8bb92e req-f577855a-5ab5-41fb-adc8-c0af5ac653a2 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:56.508135 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-aed6fe4d-8a70-4f93-bc5e-ad355b8bb92e req-f577855a-5ab5-41fb-adc8-c0af5ac653a2 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:56.522563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-aed6fe4d-8a70-4f93-bc5e-ad355b8bb92e req-f577855a-5ab5-41fb-adc8-c0af5ac653a2 service nova] Creating event network-changed:121b09fa-9774-40f8-9410-bc5765d4bce1 for instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 on hv-cinder-84456 Jun 15 19:42:56.529160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-aed6fe4d-8a70-4f93-bc5e-ad355b8bb92e req-f577855a-5ab5-41fb-adc8-c0af5ac653a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036090 Jun 15 19:42:56.530592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 276/554] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:42:58.531583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:58.532265 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:58.539335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:58.539783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:58.540583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:58.541016 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:58.572839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:42:58.666514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-45277a9b-467e-4693-87c7-4d5ea3e641ef tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 204 len: 0 microversion: 2.1 time: 0.139068 Jun 15 19:42:58.670269 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 279/555] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:42:58 2022] DELETE /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:42:58.676080 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:58.677359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:58.684564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:58.685039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:58.685816 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:58.686279 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:58.823794 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:42:58.831417 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b4e46eae-a27f-46c3-9e6d-da2f615028f0 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1507 microversion: 2.1 time: 0.159631 Jun 15 19:42:58.831981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 277/556] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:58 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:42:59.850185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:42:59.850893 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:42:59.857707 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:59.858184 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:42:59.858957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:42:59.859390 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:00.014220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:00.022474 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a3153eb6-3af4-4f1e-b6f2-f29158b0f7a8 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1507 microversion: 2.1 time: 0.177027 Jun 15 19:43:00.023014 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 280/557] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:42:59 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:01.039732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:01.040373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:01.046922 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:01.047356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:01.048124 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:01.048567 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:01.225090 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:01.234852 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0a431fda-660a-4f4e-96f5-cbffb421a598 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1507 microversion: 2.1 time: 0.198628 Jun 15 19:43:01.235469 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 278/558] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:01 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:01.966611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-2c249d62-75f2-4afc-921c-127c504b6a44 req-2cdbdad9-75a1-4966-a126-0e299bea732b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3306831f-c20a-46c5-acaa-5420a83ae130", "name": "network-vif-deleted", "tag": "47e168a5-c1f1-42dd-b5ac-e995fc3c66c4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:01.976988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-2c249d62-75f2-4afc-921c-127c504b6a44 req-2cdbdad9-75a1-4966-a126-0e299bea732b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:01.977466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-2c249d62-75f2-4afc-921c-127c504b6a44 req-2cdbdad9-75a1-4966-a126-0e299bea732b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:01.989823 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-2c249d62-75f2-4afc-921c-127c504b6a44 req-2cdbdad9-75a1-4966-a126-0e299bea732b service nova] Creating event network-vif-deleted:47e168a5-c1f1-42dd-b5ac-e995fc3c66c4 for instance 3306831f-c20a-46c5-acaa-5420a83ae130 on hv-cinder-84456 Jun 15 19:43:01.995521 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-2c249d62-75f2-4afc-921c-127c504b6a44 req-2cdbdad9-75a1-4966-a126-0e299bea732b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032459 Jun 15 19:43:01.996120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 281/559] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:43:02.253474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:02.254115 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:02.262698 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.263155 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.263940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.264372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.267963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155cac21-746d-4119-be07-fe1fd8182696"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:02.269658 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:02.277117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.277654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.278546 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.279331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.299157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.299657 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.300122 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'fault' on Instance uuid 3306831f-c20a-46c5-acaa-5420a83ae130 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:43:02.354718 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:02.366371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-277e5a89-1de9-44f5-b6a1-baab404f037d tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 200 len: 1312 microversion: 2.1 time: 0.116675 Jun 15 19:43:02.367198 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 279/560] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:02 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:02.390515 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Invalid volume: volume 155cac21-746d-4119-be07-fe1fd8182696 is already attached to instances: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: POST /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments HTTP/1.1 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 74 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:02.392403 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {"volumeAttachment": {"volumeId": "155cac21-746d-4119-be07-fe1fd8182696"}} Jun 15 19:43:02.393997 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Invalid volume: volume 155cac21-746d-4119-be07-fe1fd8182696 is already attached to instances: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'server_id': '0a1dd930-31d9-48b7-a30e-28d7f7dc7378', 'body': {'volumeAttachment': {'volumeId': '155cac21-746d-4119-be07-fe1fd8182696'}}} Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 155cac21-746d-4119-be07-fe1fd8182696 is already attached to instances: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:02.395598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 155cac21-746d-4119-be07-fe1fd8182696 is already attached to instances: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:02.396710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 155cac21-746d-4119-be07-fe1fd8182696 is already attached to instances: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 400 to user: Invalid volume: volume 155cac21-746d-4119-be07-fe1fd8182696 is already attached to instances: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7e3b62d0-bf23-479f-82a9-5c6e1ed818d6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.130466 Jun 15 19:43:02.397885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 282/561] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:43:02 2022] POST /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 19:43:02.472503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:02.473063 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:02.480843 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.481299 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.482082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.482558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.567426 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lazy-loading 'services' on Instance uuid 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:43:02.640342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6437a1df-1b0a-4365-96cf-ca89c0d35bfe tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments/155cac21-746d-4119-be07-fe1fd8182696" status: 202 len: 0 microversion: 2.1 time: 0.171637 Jun 15 19:43:02.640944 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 280/562] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:43:02 2022] DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments/155cac21-746d-4119-be07-fe1fd8182696 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 19:43:02.649446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:02.650599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:02.657068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.657567 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.658427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:02.658928 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:02.691000 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ec123ed4-0bec-46d4-b420-4d9c04632b71 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Jun 15 19:43:02.691568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 283/563] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:43:02 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:43:03.384979 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.385677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 3306831f-c20a-46c5-acaa-5420a83ae130] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.391985 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.392439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.393217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.393656 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.411859 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] HTTP exception thrown: Instance 3306831f-c20a-46c5-acaa-5420a83ae130 could not be found. Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Request method failure captured: Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 HTTP/1.1 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUbZ4qQjAiJYFrc8uCgnNNVTiUog9NrJ2Az8mjSYdHbZAr7Tmr4xQ3AtjSj3bma_7bsijzbaQazE9MmzaBOOmRXK8fi_RBQR_x9fyIgr_tq7YYj-IQ-JkoCC1eLyxHZifmpPwUL-ssx5ZgL1u4p31qBuGBMNqRFmexF6-sIYC732O8 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:03.413408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d5270cd64fd4929af7b063cf2e2b653", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d5270cd64fd4929af7b063cf2e2b653"}]}] Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f26a832b69564f2a8387215afba6730e Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 3306831f-c20a-46c5-acaa-5420a83ae130 could not be found. Jun 15 19:43:03.414815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '3306831f-c20a-46c5-acaa-5420a83ae130'} Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3306831f-c20a-46c5-acaa-5420a83ae130 could not be found. Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:03.415558 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3306831f-c20a-46c5-acaa-5420a83ae130 could not be found. Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3306831f-c20a-46c5-acaa-5420a83ae130 could not be found. Jun 15 19:43:03.416846 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:03.417965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Returning 404 to user: Instance 3306831f-c20a-46c5-acaa-5420a83ae130 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:03.417965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5a6c2fd3-8b08-4b09-9c59-af6030055649 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130" status: 404 len: 111 microversion: 2.1 time: 0.034206 Jun 15 19:43:03.417965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 284/564] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:03 2022] GET /compute/v2.1/servers/3306831f-c20a-46c5-acaa-5420a83ae130 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:43:03.424522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.425104 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.431136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.431735 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.432521 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.432953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.459386 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:43:03.481903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.482502 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.489068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.490185 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.491169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.491732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.516394 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-99a55de0-7f3c-4ad2-ba17-d787eb10ce2a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/ips" status: 200 len: 153 microversion: 2.20 time: 0.165696 Jun 15 19:43:03.516990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 281/565] 10.222.0.15 () {60 vars in 1288 bytes} [Wed Jun 15 19:43:03 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/ips => generated 153 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:43:03.544281 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1dc90918-8102-4d10-9730-9157d43e7b96 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "DELETE /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 204 len: 0 microversion: 2.1 time: 0.123129 Jun 15 19:43:03.545787 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 285/566] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:43:03 2022] DELETE /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:43:03.553945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.554909 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.562763 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.563218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.564028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.564487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.703527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.704585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.713068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:03.717086 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.717539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.718352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.722067 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.726070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4813f950-4a83-45a5-86dc-c9e3d911a354 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.176105 Jun 15 19:43:03.726933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 282/567] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:03 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:43:03.765357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3270947b-70a8-465d-8001-a89abb11c166 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065885 Jun 15 19:43:03.766017 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 286/568] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:43:03 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 19:43:03.833694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.834376 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.841068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.841524 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.842334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.842890 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.869347 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:43:03.948496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-46a3a628-0f25-47c0-acb5-f2003d59ca43 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 204 len: 0 microversion: 2.1 time: 0.119143 Jun 15 19:43:03.949002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 283/569] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:43:03 2022] DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:43:03.958049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:03.958679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:03.964734 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.965179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:03.965933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:03.966389 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:04.101406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:04.109627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d3e9359c-c60f-4677-bded-9f23f14f7b9a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1677 microversion: 2.1 time: 0.156287 Jun 15 19:43:04.110277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 287/570] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:03 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:04.849048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:04.849842 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:04.856204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:04.856656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:04.857439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:04.857874 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:05.004952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:05.013081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-00cd8dc4-b3c5-4464-b3cb-df8441314101 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.270133 Jun 15 19:43:05.013675 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 284/571] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:04 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:05.127380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:05.128144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:05.134868 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:05.135322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:05.136106 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:05.136538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:05.273405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:05.280994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b6a95d09-031d-46d7-b4c8-8ec8a5b2b0ff tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1677 microversion: 2.1 time: 0.157558 Jun 15 19:43:05.281565 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 288/572] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:05 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:06.033332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:06.036150 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:06.037996 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:06.047271 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.047921 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.049038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.049653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.172981 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:06.173600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:06.176769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:06.183143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.183607 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.184385 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.184857 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.215488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lazy-loading 'flavor' on Instance uuid 29d61603-5469-4233-b4a1-95259f1fc06b {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:43:06.220095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:06.229360 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d677657d-5276-4d85-87ec-0472d2f1d384 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.200312 Jun 15 19:43:06.230334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 285/573] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:06 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:43:06.265481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:06.298002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:06.298659 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:06.306110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.306679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.307542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.308027 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.480453 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:06.492928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7fc0221d-31eb-4fd2-8139-f7e91171ea40 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1677 microversion: 2.1 time: 0.198348 Jun 15 19:43:06.493822 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 286/574] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:06 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:43:06.495022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-868c2aae-8495-4933-8ec4-46dd0f2f04ef tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/action" status: 202 len: 0 microversion: 2.20 time: 0.325747 Jun 15 19:43:06.495926 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 289/575] 10.222.0.15 () {62 vars in 1318 bytes} [Wed Jun 15 19:43:06 2022] POST /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:43:06.512953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:06.513621 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:06.520197 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.520656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.521433 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:06.521873 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:06.666754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:06.675112 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:06.676738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:06.677886 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7117450c-ab26-4cbe-9467-5cce8b7fddd3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.176858 Jun 15 19:43:06.678480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 287/576] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:06 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:07.251692 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:07.252652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:07.261549 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:07.262343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:07.263453 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:07.264122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:07.463493 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:07.471372 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8bb2d44a-6b25-43aa-b1ed-556c9b256ec7 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.227760 Jun 15 19:43:07.471952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 290/577] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:07 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:07.515244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:07.516015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:07.525110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:07.525563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:07.526376 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:07.526813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:07.691982 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:07.700256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f2a52586-e4c7-4fb4-a9c4-255d600238b5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1677 microversion: 2.1 time: 0.190839 Jun 15 19:43:07.700846 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 288/578] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:07 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:07.700960 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:07.701826 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:07.712113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:07.712808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:07.714015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:07.714734 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:07.897787 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:07.915496 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:07.917082 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:07.918307 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-41633484-af73-4bd0-a3a3-08b49527d14c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.223914 Jun 15 19:43:07.918892 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 291/579] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:07 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:43:08.491503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:08.492428 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:08.501924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:08.502662 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:08.503717 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:08.504346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:08.683271 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:08.691969 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-05f41809-218b-4916-8e6c-da80d80ee40f tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1521 microversion: 2.1 time: 0.206657 Jun 15 19:43:08.692492 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 289/580] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:08 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:08.723786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:08.724560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:08.731837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:08.732322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:08.733294 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:08.733742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:08.931395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:08.945147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-951ea1bc-6c60-4be4-b75d-526f7d6c0df6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1677 microversion: 2.1 time: 0.226100 Jun 15 19:43:08.947265 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:08.948617 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:08.951812 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 292/581] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:08 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:08.955844 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:08.956448 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:08.957269 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:08.957875 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:08.979739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:09.118858 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:09.128015 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:09.132313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:09.135664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1cfa094c-ef93-42c8-bbee-582304dffc04 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.195656 Jun 15 19:43:09.137691 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 290/582] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:08 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:09.387181 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-01365082-3235-4fef-b699-384211e00833 req-c1c3cbe6-528e-420d-93a2-d5b688bb6a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831dd3a2-1d82-45da-a99f-000c5954e54b", "name": "network-vif-deleted", "tag": "bd7a10f2-591a-4870-ae8b-2b8a7ccd8af7"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:09.396448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-01365082-3235-4fef-b699-384211e00833 req-c1c3cbe6-528e-420d-93a2-d5b688bb6a90 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:09.396902 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-01365082-3235-4fef-b699-384211e00833 req-c1c3cbe6-528e-420d-93a2-d5b688bb6a90 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:09.409752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-01365082-3235-4fef-b699-384211e00833 req-c1c3cbe6-528e-420d-93a2-d5b688bb6a90 service nova] Creating event network-vif-deleted:bd7a10f2-591a-4870-ae8b-2b8a7ccd8af7 for instance 831dd3a2-1d82-45da-a99f-000c5954e54b on hv-cinder-84456 Jun 15 19:43:09.414842 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-01365082-3235-4fef-b699-384211e00833 req-c1c3cbe6-528e-420d-93a2-d5b688bb6a90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031185 Jun 15 19:43:09.415679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 293/583] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:09.716507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:09.717491 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:09.738810 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:09.740229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:09.741345 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:09.741802 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:09.814286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:09.815225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:09.815889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lazy-loading 'fault' on Instance uuid 831dd3a2-1d82-45da-a99f-000c5954e54b {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:43:09.893703 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26a832b69564f2a8387215afba6730e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5270cd64fd4929af7b063cf2e2b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:09.911810 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b07dd9f5-2aef-4b21-adb0-03c3c7b3902e tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 200 len: 1312 microversion: 2.1 time: 0.206653 Jun 15 19:43:09.912673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 291/584] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:09 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:09.969889 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:09.970647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:09.979433 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:09.979928 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:09.983338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:09.983942 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:10.027332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:43:10.027851 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:43:10.032825 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:10.033466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:10.034122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lazy-loading 'fault' on Instance uuid 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:43:10.098699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:10.108520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8b08838d-5f91-4791-83df-113845c6b534 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 200 len: 1330 microversion: 2.1 time: 0.144203 Jun 15 19:43:10.109148 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 294/585] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:09 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 1330 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:10.158699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:10.159196 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:10.165857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:10.166333 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:10.167171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:10.167603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:10.359049 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:10.370944 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:10.372961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:10.374425 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a2ade586-d2b3-4f11-afa4-9b5b819f5aa1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.220987 Jun 15 19:43:10.386786 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 292/586] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:10 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:10.939602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:10.939602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] [instance: 831dd3a2-1d82-45da-a99f-000c5954e54b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:10.946442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:10.947023 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:10.947868 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:10.948572 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:10.965066 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] HTTP exception thrown: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b could not be found. Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Request method failure captured: Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b HTTP/1.1 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUbZ4qQjAiJYFrc8uCgnNNVTiUog9NrJ2Az8mjSYdHbZAr7Tmr4xQ3AtjSj3bma_7bsijzbaQazE9MmzaBOOmRXK8fi_RBQR_x9fyIgr_tq7YYj-IQ-JkoCC1eLyxHZifmpPwUL-ssx5ZgL1u4p31qBuGBMNqRFmexF6-sIYC732O8 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:10.966776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0d5270cd64fd4929af7b063cf2e2b653", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0d5270cd64fd4929af7b063cf2e2b653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0d5270cd64fd4929af7b063cf2e2b653"}]}] Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 0d5270cd64fd4929af7b063cf2e2b653 Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245577952 Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f26a832b69564f2a8387215afba6730e Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245577952-project Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b could not be found. Jun 15 19:43:10.969432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '831dd3a2-1d82-45da-a99f-000c5954e54b'} Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b could not be found. Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:10.971511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b could not be found. Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b could not be found. Jun 15 19:43:10.974603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:10.976880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] Returning 404 to user: Instance 831dd3a2-1d82-45da-a99f-000c5954e54b could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:10.976880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cdca32b8-8346-4de2-b9a5-c195eac4e333 tempest-ServerRescueNegativeTestJSON-1245577952 tempest-ServerRescueNegativeTestJSON-1245577952-project] 10.222.0.15 "GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b" status: 404 len: 111 microversion: 2.1 time: 0.034739 Jun 15 19:43:10.976880 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 295/587] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:10 2022] GET /compute/v2.1/servers/831dd3a2-1d82-45da-a99f-000c5954e54b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:43:11.271360 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:11.271973 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:11.283888 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:11.284343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:11.285175 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:11.285618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:11.300657 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 HTTP/1.1 Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:43:11.302455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:43:11.304260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '0a1dd930-31d9-48b7-a30e-28d7f7dc7378'} Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:11.305182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:43:11.306618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:11.307903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:11.307903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0f59e8ac-9c11-4963-947c-5c8f093c4866 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 404 len: 111 microversion: 2.1 time: 0.179580 Jun 15 19:43:11.308351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 293/588] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:11 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:43:11.319774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b4427f3e-6462-466c-badd-6f6db2f75aaf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '.version_select at 0x7f16458ed3a0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:11.345608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b4427f3e-6462-466c-badd-6f6db2f75aaf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-580426683" status: 202 len: 0 microversion: 2.1 time: 0.030754 Jun 15 19:43:11.349901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 296/589] 10.222.0.15 () {58 vars in 1217 bytes} [Wed Jun 15 19:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-580426683 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:43:11.417257 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:11.418373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:11.436788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:11.439204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:11.440928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:11.446249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:11.560391 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-b7e3d09a-d566-44a4-8d2d-17312b6a9157 req-58f9b5d3-57a9-4b7f-a7a3-d1d8522ad0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1dd930-31d9-48b7-a30e-28d7f7dc7378", "name": "network-vif-deleted", "tag": "758322d5-263d-4d0a-87b4-7f197c2860e3"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:11.570576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-b7e3d09a-d566-44a4-8d2d-17312b6a9157 req-58f9b5d3-57a9-4b7f-a7a3-d1d8522ad0a8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:11.571167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-b7e3d09a-d566-44a4-8d2d-17312b6a9157 req-58f9b5d3-57a9-4b7f-a7a3-d1d8522ad0a8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:11.589167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-b7e3d09a-d566-44a4-8d2d-17312b6a9157 req-58f9b5d3-57a9-4b7f-a7a3-d1d8522ad0a8 service nova] Creating event network-vif-deleted:758322d5-263d-4d0a-87b4-7f197c2860e3 for instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 on hv-cinder-84456 Jun 15 19:43:11.594204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-b7e3d09a-d566-44a4-8d2d-17312b6a9157 req-58f9b5d3-57a9-4b7f-a7a3-d1d8522ad0a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159082 Jun 15 19:43:11.594971 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 297/590] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:11.809699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:11.824569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:11.827627 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:11.829582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ac3bb81f-6f27-4133-8bc1-7cfe4c40f4ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.438060 Jun 15 19:43:11.834409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 294/591] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:11 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:12.239283 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-97cc9896-e42e-4241-bf31-7d490b2ac8b8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: .version_select at 0x7f16457e2670>, body: {"keypair": {"name": "tempest-keypair-245035578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWRsxT7JPxTt+Qf41S+428k378yPP84yH9w7ZUnePm/i9HalU8YcD5mAnNzSFCSncgUhrY76g2e97howcWoJ6tF/MnQd/AZcrDa8Cut/DKzQ3sMTzwjrpmpeGfV2Ef+SA=="}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:12.259237 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-97cc9896-e42e-4241-bf31-7d490b2ac8b8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:43:12.263627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-97cc9896-e42e-4241-bf31-7d490b2ac8b8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'key_pairs'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:43:12.290595 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-97cc9896-e42e-4241-bf31-7d490b2ac8b8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060362 Jun 15 19:43:12.291440 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 298/592] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:43:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:12.855698 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:12.856312 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:12.864179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:12.865070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:12.865863 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:12.866536 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:13.117270 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:13.127576 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:13.130348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:13.132466 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5a5f3f2e-8668-41bc-b0a5-5a16ea1af705 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.281576 Jun 15 19:43:13.143756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 295/593] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:12 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:14.002540 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-947264969", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ed2ffb-2899-41f6-afeb-0cd1a1d94e79"}], "security_groups": [{"name": "tempest-securitygroup--768143990"}], "key_name": "tempest-keypair-245035578", "user_data": "}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:14.143961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] validate_networks() for [('25ed2ffb-2899-41f6-afeb-0cd1a1d94e79', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:43:14.154440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:14.155329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:14.167558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:14.168331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:14.169480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:14.171055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:14.686556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:14.696146 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:14.697773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:14.699065 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6da1e0b8-7d11-470c-a6cc-3a6c067ec4c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.551232 Jun 15 19:43:14.706014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 296/594] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:14 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:15.072516 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:43:15.073257 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:43:15.074155 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:43:15.074984 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:43:15.075620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:43:15.092010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:15.092774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:15.093636 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:15.094389 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:15.116113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:43:15.121245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Getting quotas for user e1635576dfe242f88ec1abb7be6359fb and project e8e1414ffa3548938432aed200c75736. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:43:15.137191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:43:15.139653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:43:15.205336 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ea8a8129-0377-4e79-8b6d-af472100a195 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.208887 Jun 15 19:43:15.206347 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 299/595] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:43:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:43:15.220143 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7bbd04d7-10bb-45f6-92e6-b63222dbfbad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:15.222081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7bbd04d7-10bb-45f6-92e6-b63222dbfbad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:15.299110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7bbd04d7-10bb-45f6-92e6-b63222dbfbad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:15.307849 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7bbd04d7-10bb-45f6-92e6-b63222dbfbad tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1240 microversion: 2.1 time: 0.093886 Jun 15 19:43:15.309022 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 297/596] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:15 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:15.719179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:15.720068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:15.729688 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:15.730359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:15.731598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:15.732255 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:15.884577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:15.894788 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:15.896616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:15.897978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-95c645e5-5fb8-4ec5-9269-248946dfbed3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.184605 Jun 15 19:43:15.898898 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 300/597] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:15 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:16.325538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:16.326243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:16.334414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:16.334863 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:16.335639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:16.336075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:16.403837 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:16.412499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-996b96d2-1c68-44a4-8117-0a966294a263 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1292 microversion: 2.1 time: 0.090693 Jun 15 19:43:16.422574 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 298/598] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:16 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:16.923740 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:16.924336 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:16.930551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:16.930997 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:16.931758 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:16.932180 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:16.964315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-295368e2-bc89-4626-b42e-7ee99eb9e41c tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Action: 'create', calling method: .version_select at 0x7f1645824b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-850354500", "metadata": {"Type": "work"}}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-295368e2-bc89-4626-b42e-7ee99eb9e41c tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Request method failure captured: Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 121 Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjZU3a3MjQ7V3PFySGMONEZx60aFRnO4-2G_-Y5KlJTpa9vyLwrseqPpyqQ2xMwsZli5SlyiMQ7-jFKJJXq0wOxfu0xn4cnXQkNBwHQhVb67wZmqCm4jccvsJUfjwXBih5u4ylNdZFAN5PMH7G6dbsBH7o34F6jNonxBEA_50qtIJQ0 Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:16.977705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7776863ddeb74fb28b1b8ea207cfa1da", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7776863ddeb74fb28b1b8ea207cfa1da"}]}] Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: ee9987a4b9e84333aa49dad2628165eb Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-850354500", "metadata": {"Type": "work"}}} Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:43:16.979262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-850354500', 'metadata': {'Type': 'work'}}}} Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise error Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:16.980217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 19:43:16.981650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 19:43:16.982886 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 19:43:16.982886 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:16.983812 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-295368e2-bc89-4626-b42e-7ee99eb9e41c tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:16.984970 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-295368e2-bc89-4626-b42e-7ee99eb9e41c tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151767 Jun 15 19:43:16.985861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 301/599] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Jun 15 19:43:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:43:16.995665 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5afb27b1-71ac-4714-8231-af7345c5917e tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Action: 'create', calling method: .version_select at 0x7f164588e430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-437642364", "metadata": {"Type": "work"}}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5afb27b1-71ac-4714-8231-af7345c5917e tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Request method failure captured: Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 119 Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjZU3a3MjQ7V3PFySGMONEZx60aFRnO4-2G_-Y5KlJTpa9vyLwrseqPpyqQ2xMwsZli5SlyiMQ7-jFKJJXq0wOxfu0xn4cnXQkNBwHQhVb67wZmqCm4jccvsJUfjwXBih5u4ylNdZFAN5PMH7G6dbsBH7o34F6jNonxBEA_50qtIJQ0 Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:16.999135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7776863ddeb74fb28b1b8ea207cfa1da", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7776863ddeb74fb28b1b8ea207cfa1da"}]}] Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: ee9987a4b9e84333aa49dad2628165eb Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-437642364", "metadata": {"Type": "work"}}} Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:43:17.000643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-437642364', 'metadata': {'Type': 'work'}}}} Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise error Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi '0' Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:17.001548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 19:43:17.003292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 19:43:17.004644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 19:43:17.004644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.004644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5afb27b1-71ac-4714-8231-af7345c5917e tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:17.004644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5afb27b1-71ac-4714-8231-af7345c5917e tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009569 Jun 15 19:43:17.004644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 302/600] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Jun 15 19:43:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 19:43:17.012597 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bb741c86-1400-4d4d-a2ac-1e0d04491207 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Action: 'create', calling method: .version_select at 0x7f1645824b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1530408560", "metadata": {"Type": "work"}}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bb741c86-1400-4d4d-a2ac-1e0d04491207 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Request method failure captured: Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 119 Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjZU3a3MjQ7V3PFySGMONEZx60aFRnO4-2G_-Y5KlJTpa9vyLwrseqPpyqQ2xMwsZli5SlyiMQ7-jFKJJXq0wOxfu0xn4cnXQkNBwHQhVb67wZmqCm4jccvsJUfjwXBih5u4ylNdZFAN5PMH7G6dbsBH7o34F6jNonxBEA_50qtIJQ0 Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:17.015302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7776863ddeb74fb28b1b8ea207cfa1da", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7776863ddeb74fb28b1b8ea207cfa1da"}]}] Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: ee9987a4b9e84333aa49dad2628165eb Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1530408560", "metadata": {"Type": "work"}}} Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:43:17.016646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1530408560', 'metadata': {'Type': 'work'}}}} Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise error Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi '' Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:17.017455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 19:43:17.018772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 19:43:17.022169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 19:43:17.022169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.022169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bb741c86-1400-4d4d-a2ac-1e0d04491207 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:17.022169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bb741c86-1400-4d4d-a2ac-1e0d04491207 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008698 Jun 15 19:43:17.022169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 303/601] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Jun 15 19:43:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:43:17.027368 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bfc7defd-042a-4dc5-893f-0ca8a851806f tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Calling method '.version_select at 0x7f164593ec10>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:17.059866 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-bfc7defd-042a-4dc5-893f-0ca8a851806f tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] HTTP exception thrown: Volume tempest-invalid-1145991596 could not be found. Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bfc7defd-042a-4dc5-893f-0ca8a851806f tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Request method failure captured: Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1145991596 HTTP/1.1 Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjZU3a3MjQ7V3PFySGMONEZx60aFRnO4-2G_-Y5KlJTpa9vyLwrseqPpyqQ2xMwsZli5SlyiMQ7-jFKJJXq0wOxfu0xn4cnXQkNBwHQhVb67wZmqCm4jccvsJUfjwXBih5u4ylNdZFAN5PMH7G6dbsBH7o34F6jNonxBEA_50qtIJQ0 Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:17.063267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7776863ddeb74fb28b1b8ea207cfa1da", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7776863ddeb74fb28b1b8ea207cfa1da"}]}] Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: ee9987a4b9e84333aa49dad2628165eb Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Volume tempest-invalid-1145991596 could not be found. Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': 'tempest-invalid-1145991596'} Jun 15 19:43:17.064937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1145991596 could not be found. (HTTP 404) (Request-ID: req-5abab563-9f42-41ba-b0b4-52219d4d93b9) Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.065797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 19:43:17.067161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1145991596 could not be found. Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:43:17.068282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1145991596 could not be found. Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1145991596 could not be found. Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bfc7defd-042a-4dc5-893f-0ca8a851806f tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Returning 404 to user: Volume tempest-invalid-1145991596 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bfc7defd-042a-4dc5-893f-0ca8a851806f tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1145991596" status: 404 len: 99 microversion: 2.1 time: 0.040965 Jun 15 19:43:17.069445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 304/602] 10.222.0.15 () {58 vars in 1217 bytes} [Wed Jun 15 19:43:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1145991596 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 19:43:17.076126 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-166e9dee-b028-4b02-8432-aa936e7e2947 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003808 Jun 15 19:43:17.077265 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 305/603] 10.222.0.15 () {58 vars in 1139 bytes} [Wed Jun 15 19:43:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 19:43:17.087744 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-766f7e5a-df90-4ad5-96ac-652a2b0ef6fa tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004227 Jun 15 19:43:17.087914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:17.088686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 306/604] 10.222.0.15 () {58 vars in 1136 bytes} [Wed Jun 15 19:43:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 15 19:43:17.097826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:17.099820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-968721e8-dc45-49a3-a39a-33d607a64e17 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Calling method '.version_select at 0x7f16457fe820>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:17.101245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:17.102705 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cfabce26-6c2a-49b9-8639-9c1aa4461c59 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.182913 Jun 15 19:43:17.103462 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 299/605] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:16 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:43:17.129771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-968721e8-dc45-49a3-a39a-33d607a64e17 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] HTTP exception thrown: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-968721e8-dc45-49a3-a39a-33d607a64e17 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Request method failure captured: Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/os-volumes/4f2f8a83-009c-4b54-aada-2a6023efac4c HTTP/1.1 Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjZU3a3MjQ7V3PFySGMONEZx60aFRnO4-2G_-Y5KlJTpa9vyLwrseqPpyqQ2xMwsZli5SlyiMQ7-jFKJJXq0wOxfu0xn4cnXQkNBwHQhVb67wZmqCm4jccvsJUfjwXBih5u4ylNdZFAN5PMH7G6dbsBH7o34F6jNonxBEA_50qtIJQ0 Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:43:17.131718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7776863ddeb74fb28b1b8ea207cfa1da", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7776863ddeb74fb28b1b8ea207cfa1da"}]}] Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: ee9987a4b9e84333aa49dad2628165eb Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '4f2f8a83-009c-4b54-aada-2a6023efac4c'} Jun 15 19:43:17.133432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. (HTTP 404) (Request-ID: req-07b38799-aea3-4456-81bf-34c641d1298b) Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.134414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 19:43:17.135750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 19:43:17.136820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-968721e8-dc45-49a3-a39a-33d607a64e17 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Returning 404 to user: Volume 4f2f8a83-009c-4b54-aada-2a6023efac4c could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-968721e8-dc45-49a3-a39a-33d607a64e17 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/4f2f8a83-009c-4b54-aada-2a6023efac4c" status: 404 len: 109 microversion: 2.1 time: 0.039197 Jun 15 19:43:17.138120 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 307/606] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:43:17 2022] DELETE /compute/v2.1/os-volumes/4f2f8a83-009c-4b54-aada-2a6023efac4c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:43:17.144811 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ae8a0cf5-93f3-468f-8480-d3f2c8ede928 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Calling method '.version_select at 0x7f16457db550>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:17.172667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-ae8a0cf5-93f3-468f-8480-d3f2c8ede928 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] HTTP exception thrown: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ae8a0cf5-93f3-468f-8480-d3f2c8ede928 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Request method failure captured: Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/os-volumes/0ef02064-6f0a-4853-971a-a9b62e9659eb HTTP/1.1 Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjZU3a3MjQ7V3PFySGMONEZx60aFRnO4-2G_-Y5KlJTpa9vyLwrseqPpyqQ2xMwsZli5SlyiMQ7-jFKJJXq0wOxfu0xn4cnXQkNBwHQhVb67wZmqCm4jccvsJUfjwXBih5u4ylNdZFAN5PMH7G6dbsBH7o34F6jNonxBEA_50qtIJQ0 Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:43:17.176092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7776863ddeb74fb28b1b8ea207cfa1da", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7776863ddeb74fb28b1b8ea207cfa1da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7776863ddeb74fb28b1b8ea207cfa1da"}]}] Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 7776863ddeb74fb28b1b8ea207cfa1da Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesNegativeTest-1928997608 Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: ee9987a4b9e84333aa49dad2628165eb Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesNegativeTest-1928997608-project Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '0ef02064-6f0a-4853-971a-a9b62e9659eb'} Jun 15 19:43:17.177563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. (HTTP 404) (Request-ID: req-cdf925bc-4cd9-405b-8e38-c9063df493b2) Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.178468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:43:17.180549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 19:43:17.182145 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ae8a0cf5-93f3-468f-8480-d3f2c8ede928 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] Returning 404 to user: Volume 0ef02064-6f0a-4853-971a-a9b62e9659eb could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ae8a0cf5-93f3-468f-8480-d3f2c8ede928 tempest-VolumesNegativeTest-1928997608 tempest-VolumesNegativeTest-1928997608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/0ef02064-6f0a-4853-971a-a9b62e9659eb" status: 404 len: 109 microversion: 2.1 time: 0.038327 Jun 15 19:43:17.183463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 300/607] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:43:17 2022] GET /compute/v2.1/os-volumes/0ef02064-6f0a-4853-971a-a9b62e9659eb => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:43:17.435977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:17.436606 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:17.444739 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:17.445645 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:17.446724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:17.447346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:17.596980 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:17.604560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a392ae44-8c10-4a1f-b344-535493c30332 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.178011 Jun 15 19:43:17.605130 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 308/608] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:17 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:18.121446 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:18.122726 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:18.141628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:18.142386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:18.143855 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:18.144499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:18.316030 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-ac8a02ee-faca-4d72-bb78-ddc433fb3c77 req-0084c480-e251-4fe9-b089-a971d843b351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccd536f-9eda-43e3-8d9c-c630c9230078", "tag": "51db7a20-102d-4070-b32a-b9df7e5cbfbb"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:18.327560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-ac8a02ee-faca-4d72-bb78-ddc433fb3c77 req-0084c480-e251-4fe9-b089-a971d843b351 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:18.328007 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-ac8a02ee-faca-4d72-bb78-ddc433fb3c77 req-0084c480-e251-4fe9-b089-a971d843b351 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:18.339746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:18.342516 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-ac8a02ee-faca-4d72-bb78-ddc433fb3c77 req-0084c480-e251-4fe9-b089-a971d843b351 service nova] Creating event network-changed:51db7a20-102d-4070-b32a-b9df7e5cbfbb for instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 on hv-cinder-84456 Jun 15 19:43:18.356098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-ac8a02ee-faca-4d72-bb78-ddc433fb3c77 req-0084c480-e251-4fe9-b089-a971d843b351 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043931 Jun 15 19:43:18.359473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 309/609] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:18.362354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:18.364165 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:18.365405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fb1583e6-56d1-43a5-a19c-3f26e246b796 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.248155 Jun 15 19:43:18.366325 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 301/610] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:18 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:18.622973 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:18.623677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:18.639019 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:18.640896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:18.642489 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:18.643181 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:18.797266 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:18.804572 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-39fcb237-74b4-40fe-be70-b6828ceee435 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.186056 Jun 15 19:43:18.805147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 310/611] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:18 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:19.384839 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:19.385564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:19.392014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:19.392650 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:19.393409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:19.393838 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:19.526945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:19.536318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:19.537995 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:19.539169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-468563f0-af94-4dc8-8f85-33ada208b5bf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.158297 Jun 15 19:43:19.539936 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 302/612] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:19 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:19.822501 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:19.823247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:19.829901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:19.830587 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:19.831564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:19.832149 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:19.973857 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:19.981392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-28596b4b-0668-4409-973c-a65b28bc9220 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.162694 Jun 15 19:43:19.981948 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 311/613] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:19 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:20.556656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:20.557261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:20.563836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:20.564282 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:20.565040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:20.565472 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:20.695153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:20.703056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:20.704554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:20.705700 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a300ffb5-1c65-45d1-b59c-612472a90172 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.152937 Jun 15 19:43:20.706286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 303/614] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:20 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:20.999020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:20.999705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:21.007156 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:21.007601 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:21.008398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:21.008832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:21.147455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:21.155049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4c96c667-a687-4b9f-94b5-6b0e418faf35 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.160178 Jun 15 19:43:21.155600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 312/615] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:20 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:21.724539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:21.725083 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:21.731521 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:21.731967 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:21.732717 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:21.733153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:21.867261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:21.875418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:21.876918 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:21.878066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-614df49b-5535-4f09-9af4-0e88264de34a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.157531 Jun 15 19:43:21.879139 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 304/616] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:21 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:22.172334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:22.172955 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:22.180018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:22.180460 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:22.181219 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:22.181643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:22.332517 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:22.340772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-768845b7-18eb-49f6-b2f4-03a64ea65bf4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.172428 Jun 15 19:43:22.341344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 313/617] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:22 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:22.897483 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:22.898123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:22.904558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:22.904994 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:22.905737 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:22.906189 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:23.040723 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:23.048517 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:23.050396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:23.051442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-eae1cbe6-a901-4b22-a5db-d09528ba89e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.158278 Jun 15 19:43:23.055210 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 305/618] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:22 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:23.356965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:23.357613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:23.364136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:23.364592 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:23.365359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:23.365797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:23.495209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:23.502566 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b8b4fd4d-a41d-4684-a7ca-640e247736bf tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.149590 Jun 15 19:43:23.503616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 314/619] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:23 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:24.069714 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:24.070644 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:24.078740 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:24.079212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:24.079984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:24.080564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:24.231499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:24.240111 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:24.241880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:24.243079 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-23da3097-0243-4cf2-8c3c-a26547bdb86f tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.177278 Jun 15 19:43:24.243930 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 306/620] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:24 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:24.519796 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:24.520410 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:24.526877 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:24.527522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:24.528295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:24.528738 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:24.672874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:24.681000 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c723d5a0-cb38-46cb-9435-9fd7b4699b0b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.165043 Jun 15 19:43:24.681568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 315/621] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:24 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:25.261908 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:25.262537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:25.269610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:25.270056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:25.270841 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:25.271299 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:25.307441 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:25.404704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:25.413240 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:25.414768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:25.415917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1f10e3ee-2774-4ea6-af73-e59243e96943 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.157959 Jun 15 19:43:25.416470 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 307/622] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:25 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:25.696586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:25.697186 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:25.699152 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:25.699808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=10 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:25.705863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:25.706331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:25.707085 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:25.707514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:25.840501 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:25.847946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9f191cf7-932a-42bd-a062-47f398b1753b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.155173 Jun 15 19:43:25.848533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 316/623] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:25 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:26.434248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:26.434862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:26.441574 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:26.442019 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:26.442806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:26.443493 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:26.571805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:26.579771 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:26.581783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:26.582953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5f0c6687-f439-4c44-826a-79ca0521b31c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.152983 Jun 15 19:43:26.583514 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 308/624] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:26 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:26.832044 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-1606f85e-d1b2-49cf-add6-587396fb44a9 req-43f89886-3d13-4bf2-98f1-86db93974165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccd536f-9eda-43e3-8d9c-c630c9230078", "name": "network-vif-plugged", "status": "completed", "tag": "51db7a20-102d-4070-b32a-b9df7e5cbfbb"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:26.840144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1606f85e-d1b2-49cf-add6-587396fb44a9 req-43f89886-3d13-4bf2-98f1-86db93974165 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:26.840577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1606f85e-d1b2-49cf-add6-587396fb44a9 req-43f89886-3d13-4bf2-98f1-86db93974165 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:26.852185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-1606f85e-d1b2-49cf-add6-587396fb44a9 req-43f89886-3d13-4bf2-98f1-86db93974165 service nova] Creating event network-vif-plugged:51db7a20-102d-4070-b32a-b9df7e5cbfbb for instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 on hv-cinder-84456 Jun 15 19:43:26.856791 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-1606f85e-d1b2-49cf-add6-587396fb44a9 req-43f89886-3d13-4bf2-98f1-86db93974165 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147859 Jun 15 19:43:26.857359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 317/625] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:26.864709 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:26.865318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:26.871597 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:26.872040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:26.872798 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:26.873227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:26.890697 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=100 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:27.006356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:27.013662 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-51d7db3d-f718-44fc-997d-a9fb93b2e42e tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.152767 Jun 15 19:43:27.014313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 309/626] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:26 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:27.602068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:27.602722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:27.608935 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:27.609389 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:27.610186 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:27.610622 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:27.614756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:27.754977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:27.763321 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:27.764819 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:27.765960 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0588d401-f910-419e-89af-7f62587498ec tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.168965 Jun 15 19:43:27.766544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 318/627] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:27 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:28.031166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:28.031775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:28.038418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:28.038866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:28.039630 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:28.040063 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:28.185070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:28.193559 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fa2886bd-607f-4f94-bdf8-77abcab9493b tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1365 microversion: 2.1 time: 0.166175 Jun 15 19:43:28.194152 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 310/628] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:28 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:28.785887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:28.786646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:28.793421 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:28.793868 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:28.794679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:28.795251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:28.961922 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:28.973239 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:28.975947 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:28.977512 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f816750c-aea7-4a4c-8007-88fb6215bfc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.196327 Jun 15 19:43:28.978181 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 319/629] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:28 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:29.211477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:29.212031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:29.218655 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:29.219092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:29.219854 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:29.220286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:29.361198 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:29.372678 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bca36d23-2b03-4d35-b554-047288361ff6 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1555 microversion: 2.1 time: 0.164924 Jun 15 19:43:29.373269 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 311/630] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:43:29 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:43:29.389963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:29.390874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:29.398948 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:29.399406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:29.400330 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:29.401049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:29.481248 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-073b3afb-534d-4ccd-b66d-503a3d0c988c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095249 Jun 15 19:43:29.481924 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 320/631] 10.222.0.15 () {58 vars in 1274 bytes} [Wed Jun 15 19:43:29 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:29.996954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:29.998047 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:30.011454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:30.011454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:30.011454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:30.011454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:30.240354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:30.248725 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:30.250245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:30.251392 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-296fb229-7e2a-4b73-8a7e-d23bd424d3d1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1746 microversion: 2.20 time: 0.258935 Jun 15 19:43:30.251939 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 312/632] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:29 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1746 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:30.586824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-0fee8d62-86a0-49e7-afbd-80d9d08dcdad req-a698429e-c83a-4f1e-9bd3-3f279fe37e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ccd536f-9eda-43e3-8d9c-c630c9230078", "tag": "51db7a20-102d-4070-b32a-b9df7e5cbfbb"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:30.595218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-0fee8d62-86a0-49e7-afbd-80d9d08dcdad req-a698429e-c83a-4f1e-9bd3-3f279fe37e43 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:30.595741 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-0fee8d62-86a0-49e7-afbd-80d9d08dcdad req-a698429e-c83a-4f1e-9bd3-3f279fe37e43 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:30.607755 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-0fee8d62-86a0-49e7-afbd-80d9d08dcdad req-a698429e-c83a-4f1e-9bd3-3f279fe37e43 service nova] Creating event network-changed:51db7a20-102d-4070-b32a-b9df7e5cbfbb for instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 on hv-cinder-84456 Jun 15 19:43:30.613174 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-0fee8d62-86a0-49e7-afbd-80d9d08dcdad req-a698429e-c83a-4f1e-9bd3-3f279fe37e43 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086150 Jun 15 19:43:30.613765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 321/633] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:31.270875 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:31.271629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:31.278564 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:31.279006 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:31.279769 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:31.280195 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:31.426900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:31.435526 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:31.437036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:31.438229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bd26dd02-4899-44c4-91c2-d14264053f2d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1746 microversion: 2.20 time: 0.171916 Jun 15 19:43:31.438795 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 313/634] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:31 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:43:32.459585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:32.460280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:32.466705 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:32.467157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:32.467899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:32.468327 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:32.598319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:32.606646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:32.608144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:32.609287 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f843fed8-54d4-4455-9989-182dce5bf230 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1746 microversion: 2.20 time: 0.155682 Jun 15 19:43:32.609843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 322/635] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:32 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:33.628359 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:33.628994 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:33.636158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:33.636158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:33.636916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:33.637401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:33.774614 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:33.782802 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:33.784306 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:33.785474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9ae1d168-5d27-4f19-adc1-674e75ac6b7a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1746 microversion: 2.20 time: 0.161080 Jun 15 19:43:33.786103 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 314/636] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:33 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:34.804487 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:34.805186 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:34.814158 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:34.814913 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:34.817142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:34.817142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:34.972841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:34.981427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:34.983940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:34.985498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-243d7ef8-7816-4ecf-ae0c-c774ae291ab5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.185740 Jun 15 19:43:34.986228 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 323/637] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:34 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:36.009527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:36.010368 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:36.019097 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:36.019873 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:36.020818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:36.021451 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:36.148248 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-25053a76-e2ab-4f5e-b3e2-3f55bb828a8d req-e52887d3-2d69-400f-9e66-9fec9d9ed146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "name": "network-vif-plugged", "status": "completed", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:36.163212 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-25053a76-e2ab-4f5e-b3e2-3f55bb828a8d req-e52887d3-2d69-400f-9e66-9fec9d9ed146 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:36.166708 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-25053a76-e2ab-4f5e-b3e2-3f55bb828a8d req-e52887d3-2d69-400f-9e66-9fec9d9ed146 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:36.191425 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-25053a76-e2ab-4f5e-b3e2-3f55bb828a8d req-e52887d3-2d69-400f-9e66-9fec9d9ed146 service nova] Creating event network-vif-plugged:e86b7374-75c4-418c-9797-1366945e2805 for instance 29d61603-5469-4233-b4a1-95259f1fc06b on hv-cinder-84456 Jun 15 19:43:36.197509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-25053a76-e2ab-4f5e-b3e2-3f55bb828a8d req-e52887d3-2d69-400f-9e66-9fec9d9ed146 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053940 Jun 15 19:43:36.198448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 324/638] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:43:36.212469 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:36.223418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:36.225377 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:36.227002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0f40c32f-b097-4b49-a64c-d98334cdbce2 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.226046 Jun 15 19:43:36.239303 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 315/639] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:35 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:37.247621 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:37.248578 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:37.255747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:37.258344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:37.258796 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:37.259586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:37.260027 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:37.429593 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:37.438793 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:37.440931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:37.442273 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e0e6f5a7-fc33-4dcb-baf1-772be743cfad tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.199497 Jun 15 19:43:37.442864 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 325/640] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:37 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:38.461420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:38.462324 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:38.466246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=64 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:38.470107 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:38.470681 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:38.472280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:38.472720 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:38.640911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:38.667416 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:38.671044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:38.672128 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-82888e93-3a71-42f1-bca7-524a6c9a49c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.215184 Jun 15 19:43:38.673412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 316/641] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:38 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:39.696665 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:39.699049 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:39.705328 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:39.705782 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:39.706589 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:39.707028 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:39.862974 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:39.872631 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:39.874169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:39.875598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f52b9081-be67-4ca3-9192-8f10fca4cfb9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.183607 Jun 15 19:43:39.883361 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 326/642] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:39 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:40.894103 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:40.894881 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:40.902142 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:40.902929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:40.903916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:40.904566 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:41.064961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:41.075291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:41.077187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:41.078361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-560aabfc-9bf0-4389-bc56-d7a0d8a499ab tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.188687 Jun 15 19:43:41.080069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 317/643] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:40 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:42.097372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:42.098831 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:42.114565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:42.115310 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:42.116295 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:42.116889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:42.200458 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:42.201608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:42.208766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:42.209416 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:42.210446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:42.211123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:42.239537 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b9bf9694-367d-431c-8007-9db986f295aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/ips" status: 200 len: 146 microversion: 2.1 time: 0.181046 Jun 15 19:43:42.256559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 327/644] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:43:42 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/ips => generated 146 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:42.554553 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:42.565351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:42.567501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:42.569510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c7057f91-7456-48cd-8829-6368b937e9d8 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.476316 Jun 15 19:43:42.572341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 318/645] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:42 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:43:43.592938 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:43.594931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:43.617415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:43.620392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:43.623542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:43.624045 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:43.805046 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:43.814179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:43.816208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:43.818401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-89e60ea2-f118-41aa-bd8e-badc3be7a26e tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.231107 Jun 15 19:43:43.819643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 328/646] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:43 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:44.840888 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:44.841504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:44.849232 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:44.849586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:44.850404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:44.850840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:44.999268 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:45.009189 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:45.010727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:45.011928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bdf127e2-05e5-4816-8ee3-d5073f087df0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1741 microversion: 2.20 time: 0.175003 Jun 15 19:43:45.012480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 319/647] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:44 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:43:45.870958 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85476bfe-8486-41f2-b583-f2f6020b3662"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:45.870958 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:45.874681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:45.875143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:45.875928 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:45.876397 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:46.031887 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:46.032647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:46.040095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:46.040546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:46.041323 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:46.041742 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:46.162469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-85bfb7bb-be33-411a-8bc5-e77d2738aa23 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300512 Jun 15 19:43:46.164392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 329/648] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:43:45 2022] POST /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:43:46.190560 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:46.201171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:46.202555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:46.204692 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4c218de6-7e99-47f0-9240-767f80031fb1 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1723 microversion: 2.20 time: 0.177517 Jun 15 19:43:46.217412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 320/649] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:46 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:47.226728 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:47.227549 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:47.238994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:47.239805 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:47.241088 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:47.241831 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:47.420653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:47.430286 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:47.431869 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:47.433076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-786163af-28a3-4292-90b1-ac7afa1b32ca tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1723 microversion: 2.20 time: 0.212158 Jun 15 19:43:47.433673 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 330/650] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:47 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:48.454540 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:48.455700 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:48.466141 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:48.466607 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:48.468193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:48.469082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:48.647832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:48.665043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:48.666638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:48.667920 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-71f80ca8-ef04-42bf-af7b-b29a593de256 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1726 microversion: 2.20 time: 0.218572 Jun 15 19:43:48.668505 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 321/651] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:48 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:48.688902 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20443f8e-49af-4669-81c9-6f55fab02a78"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:48.690856 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:48.698224 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:48.698676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:48.699446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:48.699882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:48.997196 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-95fbf214-1d57-495b-bc90-625a8fd5ac8a tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313051 Jun 15 19:43:48.997808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 331/652] 10.222.0.15 () {62 vars in 1363 bytes} [Wed Jun 15 19:43:48 2022] POST /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 19:43:49.126760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:49.127303 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:49.133724 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:49.134275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:49.135048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:49.135538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:49.421198 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-644468da-50b3-463e-b445-64001d3a27f7 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-volume_attachments/20443f8e-49af-4669-81c9-6f55fab02a78" status: 202 len: 0 microversion: 2.20 time: 0.298506 Jun 15 19:43:49.421957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 322/653] 10.222.0.15 () {60 vars in 1456 bytes} [Wed Jun 15 19:43:49 2022] DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-volume_attachments/20443f8e-49af-4669-81c9-6f55fab02a78 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:43:49.485795 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:49.486387 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:49.493280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:49.493719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:49.494783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:49.495214 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:49.553832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:49.601127 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d3ef4dd4-54f7-457f-acf6-106b337f6bb4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "POST /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/action" status: 202 len: 0 microversion: 2.20 time: 0.119349 Jun 15 19:43:49.602647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 332/654] 10.222.0.15 () {62 vars in 1318 bytes} [Wed Jun 15 19:43:49 2022] POST /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:43:49.613432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:49.615547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:49.624626 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:49.625515 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:49.626288 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:49.626754 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:49.831298 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:49.834048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:43:49.845026 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:49.846862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:49.848261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ad4037d6-bdb4-417b-bc1e-9efae78be6f3 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1674 microversion: 2.20 time: 0.240538 Jun 15 19:43:49.848818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 323/655] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:49 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:50.158548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-e5b32a61-bb12-47a9-8003-fad62cd6a428 req-afaff40e-2420-4d8b-b14f-2788bb224cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "name": "network-vif-unplugged", "status": "completed", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:43:50.171980 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-e5b32a61-bb12-47a9-8003-fad62cd6a428 req-afaff40e-2420-4d8b-b14f-2788bb224cdc service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:50.172664 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-e5b32a61-bb12-47a9-8003-fad62cd6a428 req-afaff40e-2420-4d8b-b14f-2788bb224cdc service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:50.186052 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.compute.server_external_events [req-e5b32a61-bb12-47a9-8003-fad62cd6a428 req-afaff40e-2420-4d8b-b14f-2788bb224cdc service nova] Unable to find a host for instance 29d61603-5469-4233-b4a1-95259f1fc06b. Dropping event network-vif-unplugged {{(pid=129333) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 19:43:50.187520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-e5b32a61-bb12-47a9-8003-fad62cd6a428 req-afaff40e-2420-4d8b-b14f-2788bb224cdc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034112 Jun 15 19:43:50.188963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 333/656] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 19:43:50.870927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:50.871809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:50.880013 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:50.880465 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:50.881239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:50.881869 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:51.113212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:51.123862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:51.125367 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:51.126596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-47013cb5-6996-4f3e-bbd5-58c7441a0fbd tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.261015 Jun 15 19:43:51.127202 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 324/657] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:50 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:52.150354 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:52.153198 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:52.164094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:52.164790 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:52.167089 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:52.168015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:52.411744 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:52.438105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:52.461539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:52.466456 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-13af0453-7de8-4b8e-bbd0-80dfabd35cc9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.324318 Jun 15 19:43:52.472957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 334/658] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:52 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:53.491250 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:53.492621 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:53.500904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:53.502045 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:53.502960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:53.503499 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:53.722916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:53.731721 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:53.733212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:53.734407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-011ea09d-ea6b-4602-9739-07f389f3cbbf tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.247572 Jun 15 19:43:53.735437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 325/659] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:53 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:54.756305 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:54.757427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:54.766208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:54.766942 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:54.767831 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:54.768467 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:54.991717 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:55.003735 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:55.005950 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:55.007235 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1ce0c51d-9d6c-470a-a370-d109d1b572c9 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.255219 Jun 15 19:43:55.014498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 335/660] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:54 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:56.026934 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:56.028187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:56.036648 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:56.037294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:56.038439 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:56.039119 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:56.199507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:56.209424 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:56.211297 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:56.212731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b6873688-ecf8-48a7-8c80-61172b57a509 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.191523 Jun 15 19:43:56.213943 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 326/661] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:56 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:57.238339 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:57.241240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:57.261247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:57.262206 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:57.265022 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:57.265505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:57.442004 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:57.450892 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:57.453015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:57.454958 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a2356c86-22a2-4600-bedd-cb8ab117e52d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.225821 Jun 15 19:43:57.455915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 336/662] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:57 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:58.473691 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:58.474358 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:58.493762 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:58.499336 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:58.500401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:58.500847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:58.709095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:58.720998 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:58.723255 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:58.724444 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-86a7e233-1d99-4649-874e-548a4ba03163 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.255159 Jun 15 19:43:58.725037 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 327/663] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:58 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:43:59.745559 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:43:59.746845 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:43:59.754646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:59.755253 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:59.756474 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:43:59.757021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:43:59.924544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:59.934071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:59.935743 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:43:59.937253 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e8f16147-9a71-4785-ba35-516ae1781a05 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.196792 Jun 15 19:43:59.938352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 337/664] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:43:59 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:00.956839 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:00.957410 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:00.963973 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:00.964420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:00.965178 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:00.965608 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:01.093625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:01.102016 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:01.103594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:01.104830 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9f5f257a-13ac-4c6f-bd0f-9c273315a5ff tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.152584 Jun 15 19:44:01.105434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 328/665] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:00 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:02.123792 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:02.124414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:02.131564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:02.132012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:02.132773 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:02.133239 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:02.266270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:02.274606 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:02.276181 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:02.277341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7807a3bc-bc20-4a94-88bd-deb1af211b27 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.157419 Jun 15 19:44:02.277990 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 338/666] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:02 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:03.295808 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:03.296344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:03.303361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:03.303809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:03.304567 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:03.305006 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:03.436506 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:03.445169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:03.446701 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:03.447852 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3c6fb9c6-0ed3-4f08-8a16-61fe01418f03 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.155990 Jun 15 19:44:03.448408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 329/667] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:03 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:04.465912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:04.466551 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:04.474112 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:04.474573 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:04.475608 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:04.476042 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:04.620929 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:04.638999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:04.643712 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:04.644931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e0c5c39b-0d68-4dca-b811-0162008f97af tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.182883 Jun 15 19:44:04.645742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 339/668] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:04 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:05.665135 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:05.665675 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:05.672514 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:05.673496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:05.674309 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:05.674742 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:05.810106 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:05.819390 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:05.820915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:05.822170 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-557b83cc-89be-4b1f-bcd7-fb78838a7fc4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.160975 Jun 15 19:44:05.822761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 330/669] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:05 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:06.521355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:06.522380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:06.528850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:06.529296 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:06.530048 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:06.530506 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:06.561952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8996fb05-528e-4faa-b358-38fae80769a0 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Jun 15 19:44:06.562563 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 340/670] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:44:06 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:06.573935 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:06.576231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:06.582799 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:06.583247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:06.584019 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:06.584437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:06.619040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-28f3d22b-3a78-42c7-8a71-7c1c47efce24 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/85476bfe-8486-41f2-b583-f2f6020b3662" status: 200 len: 194 microversion: 2.1 time: 0.049519 Jun 15 19:44:06.620523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 331/671] 10.222.0.15 () {58 vars in 1412 bytes} [Wed Jun 15 19:44:06 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/85476bfe-8486-41f2-b583-f2f6020b3662 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:06.845529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:06.846695 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:06.856318 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:06.856830 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:06.857944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:06.858503 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:07.011950 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:07.021514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:07.023400 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:07.024563 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b844353b-fb9f-4fda-a164-c300aea6a262 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.186911 Jun 15 19:44:07.025121 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 341/672] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:06 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:08.019732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe7a5bce-8e96-471f-9674-7045dded9b7d"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:08.020477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:08.027264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:08.027873 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:08.028827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:08.029019 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:08.044611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:08.045219 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:08.048924 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=36 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:08.054188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:08.054636 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:08.055408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:08.055843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:08.236531 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:08.248009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:08.250633 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:08.252526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-311fb8ca-0fc7-40e9-8de9-646422200529 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.213049 Jun 15 19:44:08.261835 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 342/673] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:08 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:44:08.369630 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-91fe82cb-e1f9-409c-9d63-83d916f967f7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "POST /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344880 Jun 15 19:44:08.371420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 332/674] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:44:08 2022] POST /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:08.487884 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-16dd92c2-e8a0-4785-a335-2a98de13f11a req-bde20211-e4ac-46aa-9fab-2fcb348bfba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "name": "network-vif-plugged", "status": "completed", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:08.501992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-16dd92c2-e8a0-4785-a335-2a98de13f11a req-bde20211-e4ac-46aa-9fab-2fcb348bfba8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:08.502463 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-16dd92c2-e8a0-4785-a335-2a98de13f11a req-bde20211-e4ac-46aa-9fab-2fcb348bfba8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:08.514860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-16dd92c2-e8a0-4785-a335-2a98de13f11a req-bde20211-e4ac-46aa-9fab-2fcb348bfba8 service nova] Creating event network-vif-plugged:e86b7374-75c4-418c-9797-1366945e2805 for instance 29d61603-5469-4233-b4a1-95259f1fc06b on hv-cinder-84456 Jun 15 19:44:08.523374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-16dd92c2-e8a0-4785-a335-2a98de13f11a req-bde20211-e4ac-46aa-9fab-2fcb348bfba8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041963 Jun 15 19:44:08.524553 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 343/675] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:09.275609 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:09.276299 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:09.278260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=34 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:09.285911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:09.286383 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:09.287161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:09.287595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:09.452850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:09.471545 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:09.474608 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:09.477498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4d0b50ed-7ead-4e4c-837b-6569ef374792 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.206225 Jun 15 19:44:09.479195 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 333/676] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:09 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:10.501134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:10.501134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:10.508879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:10.509321 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:10.510102 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:10.510742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:10.732168 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:10.741613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:10.743542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:10.745003 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-dda9ae5c-0e8d-4501-8cf2-0e998549c6e5 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1732 microversion: 2.20 time: 0.251446 Jun 15 19:44:10.745578 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 344/677] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:10 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:11.772334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:11.774363 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:11.788367 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:11.789474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:11.790777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:11.791555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:12.147174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:12.157624 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:12.159514 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:12.160831 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1fd00c35-9eb8-4c67-9aac-24288d5764aa tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1719 microversion: 2.20 time: 0.397486 Jun 15 19:44:12.161485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 334/678] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:11 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1719 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:16.061086 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:16.062360 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:16.072828 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:16.073564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:16.074435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:16.075093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:16.111728 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ef4200b8-3c0c-4150-9ec2-7360df60f9e7 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054727 Jun 15 19:44:16.112400 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 345/679] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:44:16 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:16.251161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:16.251739 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:16.258356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:16.258800 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:16.259742 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:16.260174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:16.290608 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-82017d51-d1f0-438e-ad4e-0c92dfc9c859 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/85476bfe-8486-41f2-b583-f2f6020b3662" status: 200 len: 194 microversion: 2.1 time: 0.043780 Jun 15 19:44:16.291850 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 335/680] 10.222.0.15 () {58 vars in 1412 bytes} [Wed Jun 15 19:44:16 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/85476bfe-8486-41f2-b583-f2f6020b3662 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:16.307175 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:16.308659 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:16.316912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:16.317341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:16.318191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:16.318765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:16.412672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lazy-loading 'services' on Instance uuid 84adebc2-eb18-4ae1-ad7f-a36c741aae45 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:44:16.492451 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bf7c6fd3-4290-4851-98ac-5046a0a5d277 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/85476bfe-8486-41f2-b583-f2f6020b3662" status: 202 len: 0 microversion: 2.1 time: 0.194735 Jun 15 19:44:16.493376 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 346/681] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:44:16 2022] DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/85476bfe-8486-41f2-b583-f2f6020b3662 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:44:17.696761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:17.697933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:17.724150 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:17.725486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:17.726509 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:17.727109 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:17.770357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7ae24a8d-5fc8-49f7-b8a2-c52a367f0e21 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/fe7a5bce-8e96-471f-9674-7045dded9b7d" status: 200 len: 194 microversion: 2.1 time: 0.111068 Jun 15 19:44:17.775701 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 336/682] 10.222.0.15 () {58 vars in 1412 bytes} [Wed Jun 15 19:44:17 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/fe7a5bce-8e96-471f-9674-7045dded9b7d => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:17.781724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:17.782456 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:17.790460 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:17.791017 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:17.791883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:17.792545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:17.937284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lazy-loading 'services' on Instance uuid 84adebc2-eb18-4ae1-ad7f-a36c741aae45 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:44:18.072876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-fdc8c960-b697-452c-a585-c2acb5147edc tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/fe7a5bce-8e96-471f-9674-7045dded9b7d" status: 202 len: 0 microversion: 2.1 time: 0.294523 Jun 15 19:44:18.076189 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 347/683] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:44:17 2022] DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments/fe7a5bce-8e96-471f-9674-7045dded9b7d => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:44:18.132062 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:18.132553 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:18.146884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:18.147415 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:18.148372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:18.149225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:18.217971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-009bd7d1-a7fb-4f14-97be-9807da9f8dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/ips" status: 200 len: 150 microversion: 2.1 time: 0.097762 Jun 15 19:44:18.219672 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 337/684] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:44:18 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/ips => generated 150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:19.319404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:19.321568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:19.345896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.346578 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.347540 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.348132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.384006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:19.401696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-72c3afc8-eaf2-414f-989e-e038e4b12d8a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086219 Jun 15 19:44:19.403676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 348/685] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:44:19 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:44:19.542829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:19.543828 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:19.551640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.552089 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.553049 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.553487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.597105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8e09b480-dc7d-4c0b-bb8a-8bcc672685b4 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058108 Jun 15 19:44:19.598788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 338/686] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:44:19 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:44:19.673682 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:19.674551 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:19.681941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.682571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.683495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.684156 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.729640 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:44:19.878038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c54926d4-49aa-4e53-af3a-422a54b74fc4"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:19.880888 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:19.895575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-62f1e288-43ba-4323-af27-fd7edfb821ad tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 204 len: 0 microversion: 2.1 time: 0.230247 Jun 15 19:44:19.896248 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 349/687] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:19 2022] DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:44:19.903916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.905237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.911948 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.912704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.928028 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:19.928745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:19.958808 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:19.959850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.960367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:19.964388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:19.965300 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:20.395328 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:20.404442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-99c61b90-8394-44b2-8e83-5221d6269879 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1675 microversion: 2.1 time: 0.503348 Jun 15 19:44:20.416217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 350/688] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:19 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1675 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:21.068838 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1e4fb1b5-5b46-4110-b443-b560f8c17a26 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Action: 'create', calling method: .version_select at 0x7f16457fe430>, body: {"keypair": {"name": "tempest-TestShelveInstance-146664860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuWfTVu2LPoSwg49dJ1EOOmQxrg72yjeY5IDSBzpRx1Y6kq9dCHYYfhqgxA5zctZ3gJFuBSGA20slARLDSzQcqw8KXLU9TzzHbbMaAz4zRJ5Tp0oSt97OxmBwB8OprALQ=="}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:21.086414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-1e4fb1b5-5b46-4110-b443-b560f8c17a26 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Getting quotas for project feaa96a8901e42c18c270c092a40fc83. Resources: {'key_pairs'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:44:21.091177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-1e4fb1b5-5b46-4110-b443-b560f8c17a26 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Getting quotas for user 4ca9a3e7826b4928863bd83a9496205a and project feaa96a8901e42c18c270c092a40fc83. Resources: {'key_pairs'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:44:21.116159 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1e4fb1b5-5b46-4110-b443-b560f8c17a26 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.260490 Jun 15 19:44:21.117090 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 351/689] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:44:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:21.443141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:21.444163 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:21.466295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:21.466944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:21.468309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:21.468973 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:21.692514 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-98b58ed5-33fe-48fc-ad81-7e5398c16a63 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "POST /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.819623 Jun 15 19:44:21.695387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 339/690] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:44:19 2022] POST /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments => generated 194 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:21.714386 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:21.732222 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b437baff-c63e-413f-b9a6-8512b8d5ed64 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1675 microversion: 2.1 time: 0.309860 Jun 15 19:44:21.733612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 352/691] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:21 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:22.763905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:22.765729 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:22.779955 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:22.781647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:22.783756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:22.786692 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:22.910973 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-64003c55-59b3-40ae-bd84-ba5a45de8158 req-e6a40f4e-8fb9-48b3-9d43-b96273a3a63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84adebc2-eb18-4ae1-ad7f-a36c741aae45", "name": "network-vif-deleted", "tag": "121b09fa-9774-40f8-9410-bc5765d4bce1"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:22.962037 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-64003c55-59b3-40ae-bd84-ba5a45de8158 req-e6a40f4e-8fb9-48b3-9d43-b96273a3a63b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:22.963180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-64003c55-59b3-40ae-bd84-ba5a45de8158 req-e6a40f4e-8fb9-48b3-9d43-b96273a3a63b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:22.987911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-64003c55-59b3-40ae-bd84-ba5a45de8158 req-e6a40f4e-8fb9-48b3-9d43-b96273a3a63b service nova] Creating event network-vif-deleted:121b09fa-9774-40f8-9410-bc5765d4bce1 for instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 on hv-cinder-84456 Jun 15 19:44:22.994123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815423179f44b219e4f8572b10355c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd64a4f6222542f19ba5729f7abe12b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:22.999269 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-64003c55-59b3-40ae-bd84-ba5a45de8158 req-e6a40f4e-8fb9-48b3-9d43-b96273a3a63b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139376 Jun 15 19:44:23.000367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 353/692] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:23.006779 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2278b268-b718-4d33-8aeb-fc5eb4b63752 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 200 len: 1607 microversion: 2.1 time: 0.259475 Jun 15 19:44:23.011965 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 340/693] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:22 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 1607 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:44:24.037552 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:24.038280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:24.046438 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:24.048680 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:24.048680 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:24.049013 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:24.070130 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] HTTP exception thrown: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Request method failure captured: Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 HTTP/1.1 Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUTWWUQy2Qmr7y3ureEv8K8Qqjy7RLDUcG2HY8Ah7zgpS90vp-9FL6MHvjvIXu6NSiGBOMa0kEiXwviQ6Fgmfrcp2mYFaXPigTdGC_9yGSXbeXXMCVgiEmMVGYk_t_ADQdTr-syfyohDPcu-vvmMRxeIdJjk57lqUBwkxKmToosgJE Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:24.071816 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd64a4f6222542f19ba5729f7abe12b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd64a4f6222542f19ba5729f7abe12b2"}]}] Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: c815423179f44b219e4f8572b10355c0 Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:24.073485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '84adebc2-eb18-4ae1-ad7f-a36c741aae45'} Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:24.074404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:24.076018 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:24.077361 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Returning 404 to user: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:24.077361 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-947c3412-eb2a-4ee5-b846-ceb98820810a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 404 len: 111 microversion: 2.1 time: 0.043127 Jun 15 19:44:24.078315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 354/694] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:24 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:24.083464 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a1a071a2-3fdc-450c-864f-435244dea68c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '.version_select at 0x7f16457c7430>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:24.110404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a1a071a2-3fdc-450c-864f-435244dea68c tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094255104" status: 202 len: 0 microversion: 2.1 time: 0.030025 Jun 15 19:44:24.114396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 341/695] 10.222.0.15 () {58 vars in 1220 bytes} [Wed Jun 15 19:44:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094255104 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 19:44:27.394616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:27.395176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:27.402191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:27.402797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:27.403509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:27.403937 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:27.419672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] HTTP exception thrown: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Request method failure captured: Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 HTTP/1.1 Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUTWWUQy2Qmr7y3ureEv8K8Qqjy7RLDUcG2HY8Ah7zgpS90vp-9FL6MHvjvIXu6NSiGBOMa0kEiXwviQ6Fgmfrcp2mYFaXPigTdGC_9yGSXbeXXMCVgiEmMVGYk_t_ADQdTr-syfyohDPcu-vvmMRxeIdJjk57lqUBwkxKmToosgJE Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:27.421295 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd64a4f6222542f19ba5729f7abe12b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd64a4f6222542f19ba5729f7abe12b2"}]}] Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: c815423179f44b219e4f8572b10355c0 Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.423919 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '84adebc2-eb18-4ae1-ad7f-a36c741aae45'} Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:27.425599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.428452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.431864 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Returning 404 to user: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:27.431864 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3bc5c283-0912-4e26-a4aa-d30dbb9df98e tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 404 len: 111 microversion: 2.1 time: 0.032667 Jun 15 19:44:27.431864 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 355/696] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:27 2022] DELETE /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:27.436002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:27.436661 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: 84adebc2-eb18-4ae1-ad7f-a36c741aae45] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:27.443559 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:27.444003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:27.444982 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:27.445416 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:27.462732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] HTTP exception thrown: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Request method failure captured: Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 HTTP/1.1 Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUTWWUQy2Qmr7y3ureEv8K8Qqjy7RLDUcG2HY8Ah7zgpS90vp-9FL6MHvjvIXu6NSiGBOMa0kEiXwviQ6Fgmfrcp2mYFaXPigTdGC_9yGSXbeXXMCVgiEmMVGYk_t_ADQdTr-syfyohDPcu-vvmMRxeIdJjk57lqUBwkxKmToosgJE Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:27.464405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd64a4f6222542f19ba5729f7abe12b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd64a4f6222542f19ba5729f7abe12b2"}]}] Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: c815423179f44b219e4f8572b10355c0 Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.466219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '84adebc2-eb18-4ae1-ad7f-a36c741aae45'} Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:27.467352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. Jun 15 19:44:27.469440 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:27.470803 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Returning 404 to user: Instance 84adebc2-eb18-4ae1-ad7f-a36c741aae45 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:27.470803 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a2329998-f535-4480-bbe7-82b60a7800aa tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45" status: 404 len: 111 microversion: 2.1 time: 0.036339 Jun 15 19:44:27.470803 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 342/697] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:27 2022] GET /compute/v2.1/servers/84adebc2-eb18-4ae1-ad7f-a36c741aae45 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:28.400484 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:28.401028 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:28.408365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.408817 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.409863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.410646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.508143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lazy-loading 'services' on Instance uuid 4ccd536f-9eda-43e3-8d9c-c630c9230078 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:44:28.585200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6e928a2a-fa81-460b-affc-04a447dd8e03 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments/c54926d4-49aa-4e53-af3a-422a54b74fc4" status: 202 len: 0 microversion: 2.1 time: 0.188737 Jun 15 19:44:28.585826 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 356/698] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:44:28 2022] DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments/c54926d4-49aa-4e53-af3a-422a54b74fc4 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:44:28.597579 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:28.598644 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:28.605583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.606474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.607367 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.607884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.617867 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:28.618994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:28.627822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.628539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.629318 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.629749 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.643507 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f1d8b780-b2ff-49c0-9a24-ff3bd203a632 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052863 Jun 15 19:44:28.644437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 343/699] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:44:28 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:28.651462 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] HTTP exception thrown: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Request method failure captured: Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e HTTP/1.1 Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUTWWUQy2Qmr7y3ureEv8K8Qqjy7RLDUcG2HY8Ah7zgpS90vp-9FL6MHvjvIXu6NSiGBOMa0kEiXwviQ6Fgmfrcp2mYFaXPigTdGC_9yGSXbeXXMCVgiEmMVGYk_t_ADQdTr-syfyohDPcu-vvmMRxeIdJjk57lqUBwkxKmToosgJE Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:28.653378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd64a4f6222542f19ba5729f7abe12b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd64a4f6222542f19ba5729f7abe12b2"}]}] Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: c815423179f44b219e4f8572b10355c0 Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.654963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': 'b7a4ed60-945d-46a9-8f53-ead05148049e'} Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:28.656407 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.658903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.660754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Returning 404 to user: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:28.660754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0d3bf3ef-7cd3-4edc-bdd5-f4f48525dc00 tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 404 len: 111 microversion: 2.1 time: 0.043644 Jun 15 19:44:28.660754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 357/700] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:28 2022] DELETE /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:44:28.666045 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:28.666699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] [instance: b7a4ed60-945d-46a9-8f53-ead05148049e] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:28.673543 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.674172 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.674827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:28.675260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:28.698557 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] HTTP exception thrown: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Request method failure captured: Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e HTTP/1.1 Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUTWWUQy2Qmr7y3ureEv8K8Qqjy7RLDUcG2HY8Ah7zgpS90vp-9FL6MHvjvIXu6NSiGBOMa0kEiXwviQ6Fgmfrcp2mYFaXPigTdGC_9yGSXbeXXMCVgiEmMVGYk_t_ADQdTr-syfyohDPcu-vvmMRxeIdJjk57lqUBwkxKmToosgJE Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:28.700134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bd64a4f6222542f19ba5729f7abe12b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bd64a4f6222542f19ba5729f7abe12b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bd64a4f6222542f19ba5729f7abe12b2"}]}] Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: bd64a4f6222542f19ba5729f7abe12b2 Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1507069329 Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: c815423179f44b219e4f8572b10355c0 Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeTestJSON-1507069329-project Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.701519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'b7a4ed60-945d-46a9-8f53-ead05148049e'} Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:28.704527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. Jun 15 19:44:28.707556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:28.710283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] Returning 404 to user: Instance b7a4ed60-945d-46a9-8f53-ead05148049e could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:28.710283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-40a0a7a5-8afc-4bc5-a6bc-8dfcd548754a tempest-AttachVolumeTestJSON-1507069329 tempest-AttachVolumeTestJSON-1507069329-project] 10.222.0.15 "GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e" status: 404 len: 111 microversion: 2.1 time: 0.039207 Jun 15 19:44:28.710283 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 344/701] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:28 2022] GET /compute/v2.1/servers/b7a4ed60-945d-46a9-8f53-ead05148049e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:29.655903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:29.656928 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:29.663614 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:29.664065 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:29.664860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:29.665298 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:29.697255 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3eba46d7-e39a-44fe-86cd-09a6447baef5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045328 Jun 15 19:44:29.697848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 358/702] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:44:29 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:44:29.759765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:29.761355 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:29.768478 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:29.768929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:29.769708 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:29.770159 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:29.802546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:44:29.890673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2a63e8c8-8f4f-46e4-826a-9fabc70537fd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 204 len: 0 microversion: 2.1 time: 0.133570 Jun 15 19:44:29.892117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 345/703] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:29 2022] DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:44:29.900428 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:29.901189 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:29.908848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:29.909390 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:29.910282 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:29.910797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:30.160454 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:30.170493 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ba6da7c0-b4d6-4cd1-966b-6ca86d6de4e7 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1680 microversion: 2.1 time: 0.273449 Jun 15 19:44:30.172079 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 359/704] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:29 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:31.192401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:31.193375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:31.210636 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:31.211166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:31.211947 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:31.212382 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:31.654349 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:31.662386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-92a890b4-3d14-4251-afdb-e32f3b8a9e31 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1680 microversion: 2.1 time: 0.476035 Jun 15 19:44:31.663171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 346/705] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:31 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1680 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:32.683687 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:32.684629 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:32.688861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=4 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:32.696442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:32.697481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:32.698560 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:32.699841 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:32.911806 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1635576dfe242f88ec1abb7be6359fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e1414ffa3548938432aed200c75736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:32.926218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d7e78579-0b13-4794-b611-566a0eae24bd tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 200 len: 1613 microversion: 2.1 time: 0.246551 Jun 15 19:44:32.956499 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 360/706] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:32 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 1613 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:33.066187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-86a9a08c-f031-4f58-ac37-0c1a52111de8 req-bf1ac9db-93c5-4d3b-8eae-41a70158f5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ccd536f-9eda-43e3-8d9c-c630c9230078", "name": "network-vif-deleted", "tag": "51db7a20-102d-4070-b32a-b9df7e5cbfbb"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:33.078424 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-86a9a08c-f031-4f58-ac37-0c1a52111de8 req-bf1ac9db-93c5-4d3b-8eae-41a70158f5f3 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:33.079243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-86a9a08c-f031-4f58-ac37-0c1a52111de8 req-bf1ac9db-93c5-4d3b-8eae-41a70158f5f3 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:33.095467 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-86a9a08c-f031-4f58-ac37-0c1a52111de8 req-bf1ac9db-93c5-4d3b-8eae-41a70158f5f3 service nova] Creating event network-vif-deleted:51db7a20-102d-4070-b32a-b9df7e5cbfbb for instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 on hv-cinder-84456 Jun 15 19:44:33.102144 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-86a9a08c-f031-4f58-ac37-0c1a52111de8 req-bf1ac9db-93c5-4d3b-8eae-41a70158f5f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040245 Jun 15 19:44:33.103465 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 347/707] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:33.947891 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:33.949384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:33.959745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:33.960205 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:33.961326 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:33.962154 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:33.986107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 HTTP/1.1 Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:33.987936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:33.989627 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '4ccd536f-9eda-43e3-8d9c-c630c9230078'} Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:33.990615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:33.992586 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:33.995079 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:33.995940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8118854b-717f-4cf4-818f-af43d5aaa507 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 404 len: 111 microversion: 2.1 time: 0.054418 Jun 15 19:44:34.006949 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c85bb0bd-75f0-47bf-a3a2-d5bae772e76c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '.version_select at 0x7f16457383a0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:34.010288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 361/708] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:33 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:34.047855 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c85bb0bd-75f0-47bf-a3a2-d5bae772e76c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245035578" status: 202 len: 0 microversion: 2.1 time: 0.045588 Jun 15 19:44:34.048636 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 348/709] 10.222.0.15 () {58 vars in 1217 bytes} [Wed Jun 15 19:44:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245035578 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 19:44:34.413448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-84108023-17e7-46ba-8e3d-449281cada65 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Action: 'create', calling method: .version_select at 0x7f164588e940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1597293689"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:34.781704 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-84108023-17e7-46ba-8e3d-449281cada65 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.532685 Jun 15 19:44:34.792476 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 362/710] 10.222.0.15 () {60 vars in 1154 bytes} [Wed Jun 15 19:44:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 535 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 15 19:44:34.800040 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3e335efd-21a0-48b9-a404-ae1ba2be4782 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457a9dc0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:34.866719 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3e335efd-21a0-48b9-a404-ae1ba2be4782 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 200 len: 345 microversion: 2.1 time: 0.072946 Jun 15 19:44:34.867807 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 349/711] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:34 2022] GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:35.880750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-55efe4f3-3b92-4f01-ab73-cc23a570561f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457993a0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:35.913537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:35.914584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:35.922373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:35.922839 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:35.923612 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:35.924044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:35.929630 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-55efe4f3-3b92-4f01-ab73-cc23a570561f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 200 len: 346 microversion: 2.1 time: 0.053247 Jun 15 19:44:35.930229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 363/712] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:35 2022] GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:35.939110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 HTTP/1.1 Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:35.940777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.942387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '4ccd536f-9eda-43e3-8d9c-c630c9230078'} Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:35.943487 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.944872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.947050 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:35.947213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7832d198-8330-4872-b20e-32aa9d85f944 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Action: 'create', calling method: .version_select at 0x7f16458e4040>, body: {"snapshot": {"volume_id": "1e0195ad-bf15-4f28-8d79-3da9c6bda6a3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-241170818"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:35.947388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-84f353e2-504d-45b4-8490-7f7c43b72dc2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 404 len: 111 microversion: 2.1 time: 0.033790 Jun 15 19:44:35.947388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 350/713] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:35 2022] DELETE /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:44:35.950698 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:35.951313 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 4ccd536f-9eda-43e3-8d9c-c630c9230078] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:35.958120 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:35.958586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:35.959354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:35.959792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:35.975340 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 HTTP/1.1 Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:35.976923 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.978260 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '4ccd536f-9eda-43e3-8d9c-c630c9230078'} Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:35.978977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. Jun 15 19:44:35.980161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:35.981266 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 4ccd536f-9eda-43e3-8d9c-c630c9230078 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:35.981266 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f49a910e-e276-4557-ac0f-952b5663a3e8 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078" status: 404 len: 111 microversion: 2.1 time: 0.031592 Jun 15 19:44:35.981266 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 351/714] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:35 2022] GET /compute/v2.1/servers/4ccd536f-9eda-43e3-8d9c-c630c9230078 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:44:36.106657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7832d198-8330-4872-b20e-32aa9d85f944 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.168768 Jun 15 19:44:36.107448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 364/715] 10.222.0.15 () {60 vars in 1161 bytes} [Wed Jun 15 19:44:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:44:36.120496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9d064521-865a-428a-8e8c-ad2792c68dc1 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457380d0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:36.153535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9d064521-865a-428a-8e8c-ad2792c68dc1 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 286 microversion: 2.1 time: 0.038652 Jun 15 19:44:36.154121 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 352/716] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:36 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:36.164554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-71f0b0d3-4556-485d-859c-b05408323a2f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645778550>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:36.198509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-71f0b0d3-4556-485d-859c-b05408323a2f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037697 Jun 15 19:44:36.199089 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 365/717] 10.222.0.15 () {58 vars in 1139 bytes} [Wed Jun 15 19:44:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:36.210403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-dc6c10ec-f2b0-4aa5-bc10-e194f41f14c8 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645738160>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:36.240960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-dc6c10ec-f2b0-4aa5-bc10-e194f41f14c8 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 286 microversion: 2.1 time: 0.034548 Jun 15 19:44:36.241522 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 353/718] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:36 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:37.255453 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d8fe9bec-8c80-4946-9e17-ad30d2179da9 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457374c0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:37.286918 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d8fe9bec-8c80-4946-9e17-ad30d2179da9 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 286 microversion: 2.1 time: 0.036444 Jun 15 19:44:37.287618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 366/719] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:37 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:38.299847 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-069b7077-283f-4711-850b-32b178c7a2ee tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645806e50>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:38.332581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-069b7077-283f-4711-850b-32b178c7a2ee tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 286 microversion: 2.1 time: 0.037643 Jun 15 19:44:38.333151 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 354/720] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:38 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:39.344883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3306a91c-e6d7-4946-b9d2-28aa7ca7f455 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645737700>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:39.376377 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3306a91c-e6d7-4946-b9d2-28aa7ca7f455 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 286 microversion: 2.1 time: 0.035783 Jun 15 19:44:39.376957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 367/721] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:39 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:40.267655 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.268284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:40.270280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:40.276112 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.276565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.277349 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.277782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.295889 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 HTTP/1.1 Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:40.297486 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.299216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '0a1dd930-31d9-48b7-a30e-28d7f7dc7378'} Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:40.300084 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.301277 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.302535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:40.302535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a0416894-ba75-4c5e-990a-bb8f893753d4 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 404 len: 111 microversion: 2.1 time: 0.036476 Jun 15 19:44:40.302535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 355/722] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:40 2022] DELETE /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:40.307878 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.308501 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 0a1dd930-31d9-48b7-a30e-28d7f7dc7378] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:40.310485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:40.316038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.316477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.317256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.317697 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.333195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 HTTP/1.1 Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:40.334810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.336550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '0a1dd930-31d9-48b7-a30e-28d7f7dc7378'} Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:40.337384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. Jun 15 19:44:40.338834 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.340434 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 0a1dd930-31d9-48b7-a30e-28d7f7dc7378 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:40.340434 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6b681771-3c18-4166-ac21-6742df547244 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378" status: 404 len: 111 microversion: 2.1 time: 0.032326 Jun 15 19:44:40.340434 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 368/723] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:40 2022] GET /compute/v2.1/servers/0a1dd930-31d9-48b7-a30e-28d7f7dc7378 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:40.346630 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.347125 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:40.353787 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.354262 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.355097 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.355522 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.390603 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d01ce129-1920-48fc-9694-5dac1aeb769d tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645792a60>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.437328 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d01ce129-1920-48fc-9694-5dac1aeb769d tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 287 microversion: 2.1 time: 0.051415 Jun 15 19:44:40.438051 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 369/724] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:40 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:40.448681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-683baa1b-06af-41c5-b9cc-1af2743c771f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16458e44c0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.521766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-683baa1b-06af-41c5-b9cc-1af2743c771f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 202 len: 0 microversion: 2.1 time: 0.076522 Jun 15 19:44:40.522677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 370/725] 10.222.0.15 () {58 vars in 1253 bytes} [Wed Jun 15 19:44:40 2022] DELETE /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:44:40.531419 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d66d414c-6ab2-4437-bf5a-38a1972d6053 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457fe9d0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.545772 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: DELETE /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 HTTP/1.1 Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:40.547437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.548898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '26e7c26a-2656-4871-bc8c-fff9ca495889'} Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:40.552765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.554188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.555577 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:40.555577 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-332c3f44-ac2e-4be9-9056-cfe52d08202a tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 404 len: 111 microversion: 2.1 time: 0.207593 Jun 15 19:44:40.555577 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 356/726] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:40 2022] DELETE /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:40.558964 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:40.559581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 26e7c26a-2656-4871-bc8c-fff9ca495889] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:40.565477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d66d414c-6ab2-4437-bf5a-38a1972d6053 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 200 len: 286 microversion: 2.1 time: 0.037541 Jun 15 19:44:40.565477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 371/727] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:40 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:44:40.566731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.567177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.567956 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:40.568395 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:40.582562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 HTTP/1.1 Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:40.584110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.586689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '26e7c26a-2656-4871-bc8c-fff9ca495889'} Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:40.587595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. Jun 15 19:44:40.588958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:40.590055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 26e7c26a-2656-4871-bc8c-fff9ca495889 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:40.590055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6eeafa5d-64ea-4f4a-8e47-8636f0ea5d7c tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889" status: 404 len: 111 microversion: 2.1 time: 0.031219 Jun 15 19:44:40.590055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 357/728] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:40 2022] GET /compute/v2.1/servers/26e7c26a-2656-4871-bc8c-fff9ca495889 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:41.511196 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1391692330", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-146664860", "security_groups": [{"name": "tempest-secgroup-smoke-301187745"}], "networks": [{"uuid": "c97fa835-6951-4e5b-beef-24701d625969"}], "block_device_mapping_v2": [{"uuid": "b5388ece-4b58-4621-8ef8-82a5e68fcbd5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:41.576560 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b37ea65c-2bee-4e2b-a6ab-980392981f28 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457a93a0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:41.606246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-b37ea65c-2bee-4e2b-a6ab-980392981f28 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] HTTP exception thrown: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b37ea65c-2bee-4e2b-a6ab-980392981f28 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Request method failure captured: Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 HTTP/1.1 Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjaiEkqHZ2ewqzeSoTDYMcCn5aOeJS0hU5MrDJDxUTI1EARzco6MQNqenO-an1zGcFIMTWbfDdHQAKFqrvxmzicUniycxU7qKeKKSHov6HMwyqoAANJeUZy57K9E0IMTLEMLjDcz34jEDPMbhHmj_wUHkg5yCnYd_W_G_NoDio-2Pag Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:41.608496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6eaa58de7a6144d08f0eab80c9ad8790", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6eaa58de7a6144d08f0eab80c9ad8790"}]}] Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f4886b5a1a8947af8a884d166f231e39 Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '32a45f9a-a1b3-47af-bce9-c88594aebbc8'} Jun 15 19:44:41.611158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. (HTTP 404) (Request-ID: req-2fe40a3a-6ff4-4e7a-b1f9-022756f42edb) Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.614245 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:44:41.617171 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 19:44:41.621783 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b37ea65c-2bee-4e2b-a6ab-980392981f28 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Returning 404 to user: Snapshot 32a45f9a-a1b3-47af-bce9-c88594aebbc8 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b37ea65c-2bee-4e2b-a6ab-980392981f28 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8" status: 404 len: 111 microversion: 2.1 time: 0.037169 Jun 15 19:44:41.626544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 358/729] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:44:41 2022] GET /compute/v2.1/os-snapshots/32a45f9a-a1b3-47af-bce9-c88594aebbc8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:41.628860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6a8a5f21-7a6c-4e0a-a4a0-6c20602b8c83 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457a93a0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:41.636699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] validate_networks() for [('c97fa835-6951-4e5b-beef-24701d625969', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:44:41.701787 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6a8a5f21-7a6c-4e0a-a4a0-6c20602b8c83 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 202 len: 0 microversion: 2.1 time: 0.085857 Jun 15 19:44:41.705288 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 359/730] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:44:41 2022] DELETE /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 19:44:41.719177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e3cbbcc3-90e4-43cf-9c25-aeedb2dfdf3f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645751e50>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:41.811224 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e3cbbcc3-90e4-43cf-9c25-aeedb2dfdf3f tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 200 len: 345 microversion: 2.1 time: 0.098476 Jun 15 19:44:41.812070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 360/731] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:41 2022] GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:41.818160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:41.818594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:41.825535 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:41.826062 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:41.826860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:41.828129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:41.844191 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 HTTP/1.1 Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:41.846757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.848971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '9d725dd8-b126-49c5-8d0f-3a02cb3331d2'} Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:41.853296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.854819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.856296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:41.856296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8b15615d-b856-4505-b829-6348669b16b2 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 404 len: 111 microversion: 2.1 time: 0.035142 Jun 15 19:44:41.856296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 361/732] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:44:41 2022] DELETE /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:41.862435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:41.863506 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] [instance: 9d725dd8-b126-49c5-8d0f-3a02cb3331d2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:41.874454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:41.875372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:41.876610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:41.877381 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:41.903386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] HTTP exception thrown: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Request method failure captured: Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 HTTP/1.1 Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUhCNEIgP_OGcckUe5EOqUv6y2XFIQOCbEmHggRWckUk3DVEn2mM5fYuiAeapj5JvvU8W1t2eZTvQjpHGyJTeic1kHyDbf-g8cZPx2rok_yWorCl-0gR0gsVTTbdzMUBtlCTNsrp2BG_bi5qOfTeBczB07cEr_4WKjWdzgKN9eWqMs Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:41.907057 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e8e1414ffa3548938432aed200c75736", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e8e1414ffa3548938432aed200c75736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e8e1414ffa3548938432aed200c75736"}]}] Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: e8e1414ffa3548938432aed200c75736 Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-176915722 Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: e1635576dfe242f88ec1abb7be6359fb Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeNegativeTest-176915722-project Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.908951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '9d725dd8-b126-49c5-8d0f-3a02cb3331d2'} Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:41.909819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. Jun 15 19:44:41.911375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:41.912686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] Returning 404 to user: Instance 9d725dd8-b126-49c5-8d0f-3a02cb3331d2 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:41.912686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a407c418-0c7e-408e-8c76-67589acedbf5 tempest-AttachVolumeNegativeTest-176915722 tempest-AttachVolumeNegativeTest-176915722-project] 10.222.0.15 "GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2" status: 404 len: 111 microversion: 2.1 time: 0.055701 Jun 15 19:44:41.912686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 362/733] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:41 2022] GET /compute/v2.1/servers/9d725dd8-b126-49c5-8d0f-3a02cb3331d2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:42.112845 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:44:42.113279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:44:42.113758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:44:42.114195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:44:42.114612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:44:42.124281 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:42.124733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:42.125542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:42.125989 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:42.144724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Getting quotas for project feaa96a8901e42c18c270c092a40fc83. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:44:42.149265 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Getting quotas for user 4ca9a3e7826b4928863bd83a9496205a and project feaa96a8901e42c18c270c092a40fc83. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:44:42.220395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:44:42.222623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5388ece-4b58-4621-8ef8-82a5e68fcbd5',volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:44:42.388706 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4b3db92b-844e-4946-919c-747e7ac14915 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.881699 Jun 15 19:44:42.390542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 372/734] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:44:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:44:42.401638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-98590ed4-e0ce-4755-8d06-0807dd16d519 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:42.402720 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-98590ed4-e0ce-4755-8d06-0807dd16d519 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:42.479456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-98590ed4-e0ce-4755-8d06-0807dd16d519 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:42.486884 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-98590ed4-e0ce-4755-8d06-0807dd16d519 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1088 microversion: 2.1 time: 0.090022 Jun 15 19:44:42.487582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 363/735] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:42 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1088 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:44:42.827913 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c7211bd5-8608-46e4-8f46-6dcf45fb6839 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645737f70>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:42.861723 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-c7211bd5-8608-46e4-8f46-6dcf45fb6839 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] HTTP exception thrown: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c7211bd5-8608-46e4-8f46-6dcf45fb6839 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Request method failure captured: Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 HTTP/1.1 Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjaiEkqHZ2ewqzeSoTDYMcCn5aOeJS0hU5MrDJDxUTI1EARzco6MQNqenO-an1zGcFIMTWbfDdHQAKFqrvxmzicUniycxU7qKeKKSHov6HMwyqoAANJeUZy57K9E0IMTLEMLjDcz34jEDPMbhHmj_wUHkg5yCnYd_W_G_NoDio-2Pag Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:42.864681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6eaa58de7a6144d08f0eab80c9ad8790", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6eaa58de7a6144d08f0eab80c9ad8790"}]}] Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f4886b5a1a8947af8a884d166f231e39 Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '1e0195ad-bf15-4f28-8d79-3da9c6bda6a3'} Jun 15 19:44:42.866343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. (HTTP 404) (Request-ID: req-6c267c09-7d0b-422a-a50b-2ae1f3949134) Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.867405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:44:42.869043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 19:44:42.870519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.871882 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.874327 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c7211bd5-8608-46e4-8f46-6dcf45fb6839 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Returning 404 to user: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:42.875441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c7211bd5-8608-46e4-8f46-6dcf45fb6839 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 404 len: 109 microversion: 2.1 time: 0.053658 Jun 15 19:44:42.876767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 373/736] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:42 2022] GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:42.886743 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c7944c5-3931-4094-af46-387dd1234f52 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f16457230d0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:42.921193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-1c7944c5-3931-4094-af46-387dd1234f52 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] HTTP exception thrown: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c7944c5-3931-4094-af46-387dd1234f52 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Request method failure captured: Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: DELETE /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 HTTP/1.1 Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjaiEkqHZ2ewqzeSoTDYMcCn5aOeJS0hU5MrDJDxUTI1EARzco6MQNqenO-an1zGcFIMTWbfDdHQAKFqrvxmzicUniycxU7qKeKKSHov6HMwyqoAANJeUZy57K9E0IMTLEMLjDcz34jEDPMbhHmj_wUHkg5yCnYd_W_G_NoDio-2Pag Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:42.923859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6eaa58de7a6144d08f0eab80c9ad8790", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6eaa58de7a6144d08f0eab80c9ad8790"}]}] Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f4886b5a1a8947af8a884d166f231e39 Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '1e0195ad-bf15-4f28-8d79-3da9c6bda6a3'} Jun 15 19:44:42.925572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. (HTTP 404) (Request-ID: req-4f664f47-4ebb-47f6-a7cb-93d61731099f) Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.926778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 19:44:42.928229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 19:44:42.929563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.930983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.933169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c7944c5-3931-4094-af46-387dd1234f52 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Returning 404 to user: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:42.934043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1c7944c5-3931-4094-af46-387dd1234f52 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 404 len: 109 microversion: 2.1 time: 0.052032 Jun 15 19:44:42.934640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 364/737] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:44:42 2022] DELETE /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:44:42.943249 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-84722ffe-083c-4aba-9393-0806a1386545 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Calling method '.version_select at 0x7f1645737e50>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:42.990210 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-84722ffe-083c-4aba-9393-0806a1386545 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] HTTP exception thrown: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-84722ffe-083c-4aba-9393-0806a1386545 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Request method failure captured: Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 HTTP/1.1 Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjaiEkqHZ2ewqzeSoTDYMcCn5aOeJS0hU5MrDJDxUTI1EARzco6MQNqenO-an1zGcFIMTWbfDdHQAKFqrvxmzicUniycxU7qKeKKSHov6HMwyqoAANJeUZy57K9E0IMTLEMLjDcz34jEDPMbhHmj_wUHkg5yCnYd_W_G_NoDio-2Pag Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:44:42.992177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6eaa58de7a6144d08f0eab80c9ad8790", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6eaa58de7a6144d08f0eab80c9ad8790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6eaa58de7a6144d08f0eab80c9ad8790"}]}] Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 6eaa58de7a6144d08f0eab80c9ad8790 Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-224437175 Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f4886b5a1a8947af8a884d166f231e39 Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-VolumesSnapshotsTestJSON-224437175-project Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '1e0195ad-bf15-4f28-8d79-3da9c6bda6a3'} Jun 15 19:44:42.994251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. (HTTP 404) (Request-ID: req-817a2c5a-e315-4373-961c-31484169bdb1) Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:42.995357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:44:42.997583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 19:44:43.000012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-84722ffe-083c-4aba-9393-0806a1386545 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] Returning 404 to user: Volume 1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-84722ffe-083c-4aba-9393-0806a1386545 tempest-VolumesSnapshotsTestJSON-224437175 tempest-VolumesSnapshotsTestJSON-224437175-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3" status: 404 len: 109 microversion: 2.1 time: 0.054546 Jun 15 19:44:43.002507 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 374/738] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:42 2022] GET /compute/v2.1/os-volumes/1e0195ad-bf15-4f28-8d79-3da9c6bda6a3 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:44:43.506979 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:43.507750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:43.515509 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:43.517059 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:43.519100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:43.519782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:43.651478 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:43.667524 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a8311904-07b0-4199-8eec-6a93bcf9f33b tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1194 microversion: 2.1 time: 0.165865 Jun 15 19:44:43.669167 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 365/739] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:43 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1194 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:44.702635 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:44.703784 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:44.715360 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:44.716012 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:44.717414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:44.718582 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:45.162139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:45.169903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f0cd96e8-641d-418f-8dfa-46f22a121d40 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.476627 Jun 15 19:44:45.173098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 375/740] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:44 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:45.810351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-d8ce8e57-98ac-43a5-8dc5-2c9bd3f68517 req-b3019f93-5c62-4c96-8fff-285d54ea171e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:45.825501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d8ce8e57-98ac-43a5-8dc5-2c9bd3f68517 req-b3019f93-5c62-4c96-8fff-285d54ea171e service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:45.827012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d8ce8e57-98ac-43a5-8dc5-2c9bd3f68517 req-b3019f93-5c62-4c96-8fff-285d54ea171e service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:45.858301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-d8ce8e57-98ac-43a5-8dc5-2c9bd3f68517 req-b3019f93-5c62-4c96-8fff-285d54ea171e service nova] Creating event network-changed:98860632-f1d4-48e3-a840-1307deb28658 for instance c00cb912-861b-45f1-a2e8-7efe52291be6 on hv-cinder-84456 Jun 15 19:44:45.865375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-d8ce8e57-98ac-43a5-8dc5-2c9bd3f68517 req-b3019f93-5c62-4c96-8fff-285d54ea171e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058645 Jun 15 19:44:45.869503 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 366/741] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:46.189908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:46.191588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:46.215098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:46.216163 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:46.218197 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:46.220101 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:46.555863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:46.565001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1f01f94a-d4d6-4f78-81a0-0a3b897af22f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.380023 Jun 15 19:44:46.565604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 376/742] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:46 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:46.625299 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-31d66814-a936-4c40-959b-426821bccb1b tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f164818ab80>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:46.690261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-31d66814-a936-4c40-959b-426821bccb1b tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2f12f58d-2770-4882-8309-1ad86da94782" status: 200 len: 351 microversion: 2.1 time: 0.070320 Jun 15 19:44:46.694138 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 367/743] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:46 2022] GET /compute/v2.1/os-volumes/2f12f58d-2770-4882-8309-1ad86da94782 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:47.582554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:47.583165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:47.589223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:47.589669 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:47.590462 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:47.590895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:47.759811 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:47.769502 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f5a6bd46-b6dd-472f-b0ff-ecc9c7131488 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.191144 Jun 15 19:44:47.770119 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 377/744] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:47 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:48.106337 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e1be6440-12d2-487a-8737-86fd9305a1b5 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f1645c91700>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:48.160945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e1be6440-12d2-487a-8737-86fd9305a1b5 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/295564e2-8b10-4326-986e-25a8233be3c7" status: 200 len: 351 microversion: 2.1 time: 0.059236 Jun 15 19:44:48.161513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 368/745] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:48 2022] GET /compute/v2.1/os-volumes/295564e2-8b10-4326-986e-25a8233be3c7 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:48.786718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:48.787335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:48.797404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:48.797936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:48.799220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:48.800063 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:48.942244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:48.950422 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-2153f8d7-34df-4fa0-adbd-5c793679953a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.167709 Jun 15 19:44:48.951107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 378/746] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:48 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:49.525678 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-eb6f33ac-31a7-47bb-89ff-a43df2c9d3af tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f16457db670>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:49.577391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-eb6f33ac-31a7-47bb-89ff-a43df2c9d3af tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/dca90be6-55b1-42c7-abe2-edc0c8d570ea" status: 200 len: 351 microversion: 2.1 time: 0.054012 Jun 15 19:44:49.577391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 369/747] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/os-volumes/dca90be6-55b1-42c7-abe2-edc0c8d570ea => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:49.587617 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e5156b3c-7f02-4896-abe6-dee55418ac2e tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f164593ec10>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:49.672035 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e5156b3c-7f02-4896-abe6-dee55418ac2e tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088120 Jun 15 19:44:49.672613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 379/748] 10.222.0.15 () {58 vars in 1133 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:49.685251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8c532155-08e5-4dcd-8181-f14dedbf0ec7 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f164575e670>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:49.772088 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8c532155-08e5-4dcd-8181-f14dedbf0ec7 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090739 Jun 15 19:44:49.772681 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 370/749] 10.222.0.15 () {58 vars in 1148 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:49.785375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b0301f15-89b5-49e2-b285-01c769969aa0 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f16457fe9d0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:49.878479 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b0301f15-89b5-49e2-b285-01c769969aa0 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.096823 Jun 15 19:44:49.879092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 380/750] 10.222.0.15 () {58 vars in 1133 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:49.890711 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-94605407-220a-4e7a-9a25-ef117ea40020 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f16457db040>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:49.973539 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:49.974200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:49.975845 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-94605407-220a-4e7a-9a25-ef117ea40020 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089335 Jun 15 19:44:49.976416 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 371/751] 10.222.0.15 () {58 vars in 1166 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:49.980600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:49.981047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:49.981822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:49.982294 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:49.985191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:49.988431 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2d9c827b-c3df-4c19-a758-98364f5b758c tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f16458113a0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:50.086327 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2d9c827b-c3df-4c19-a758-98364f5b758c tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101924 Jun 15 19:44:50.086787 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 372/752] 10.222.0.15 () {58 vars in 1169 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:44:50.104375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-65c061af-5bd4-4ffd-882c-46634cf7263e tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f1645811d30>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:50.145941 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:50.153987 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-42e4f786-4b14-48e1-abe6-119f9b9a805f tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.184522 Jun 15 19:44:50.154605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 381/753] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:49 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:50.186582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-65c061af-5bd4-4ffd-882c-46634cf7263e tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085338 Jun 15 19:44:50.187148 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 373/754] 10.222.0.15 () {58 vars in 1154 bytes} [Wed Jun 15 19:44:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:44:50.198628 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4eef21c3-4240-4b57-a2dc-1940bba0f813 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f16457e2f70>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:50.286356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4eef21c3-4240-4b57-a2dc-1940bba0f813 tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091636 Jun 15 19:44:50.286927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 382/755] 10.222.0.15 () {58 vars in 1187 bytes} [Wed Jun 15 19:44:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:50.298573 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-211b7cd7-d9ac-4ab3-9dea-9d9922c87d4e tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] Calling method '.version_select at 0x7f16458063a0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:50.387451 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-211b7cd7-d9ac-4ab3-9dea-9d9922c87d4e tempest-VolumesTestJSON-1462000549 tempest-VolumesTestJSON-1462000549-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.092546 Jun 15 19:44:50.388296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 374/756] 10.222.0.15 () {58 vars in 1154 bytes} [Wed Jun 15 19:44:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:51.172136 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:51.172748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:51.179446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:51.179903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:51.180686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:51.181124 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:51.321473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:51.330197 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b18b6d5c-08d1-4c0a-a875-9bef99569737 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.162326 Jun 15 19:44:51.330775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 383/757] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:51 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:52.348280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:52.348999 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:52.355945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:52.356387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:52.357153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:52.357579 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:52.360358 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:52.484160 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:52.496768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:52.504885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2f194d7d-febe-4374-b726-2acc053a82c9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.161026 Jun 15 19:44:52.505438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 375/758] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:52 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:44:53.518360 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:53.519280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:44:53.524263 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:53.524885 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:53.532247 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:53.532701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:53.533481 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:53.533918 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:53.705131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:53.706165 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:53.712940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:53.713394 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:53.714207 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:53.714638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:53.729542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:53.738284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a9ee6fb3-eb59-4140-ae19-90da0ca716d1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.220744 Jun 15 19:44:53.739107 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 384/759] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:53 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:53.748286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7beeb2b3-b827-43ef-98b1-444f0ccce834 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047559 Jun 15 19:44:53.749152 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 376/760] 10.222.0.15 () {60 vars in 1342 bytes} [Wed Jun 15 19:44:53 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:44:53.812147 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:53.812659 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:53.820274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:53.820717 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:53.821538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:53.822041 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:53.861873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:44:53.980102 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-037e19e4-268f-4f0b-ac1f-790edc2375cc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 204 len: 0 microversion: 2.20 time: 0.171556 Jun 15 19:44:53.981078 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 385/761] 10.222.0.15 () {60 vars in 1279 bytes} [Wed Jun 15 19:44:53 2022] DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 19:44:53.994744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:53.995682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:54.005586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:54.006643 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:54.008128 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:54.009054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:54.211357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:54.221286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:54.223105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:54.224379 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-366ed980-7fe1-4976-8185-63cb24dc756d tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.236967 Jun 15 19:44:54.225818 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 377/762] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:53 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:54.756574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:54.760364 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:54.769293 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:54.770209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:54.771032 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:54.771651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:54.980185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:54.990991 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-dddeab37-c362-4070-b25e-a8fd4b12eedf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.238760 Jun 15 19:44:54.991878 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 386/763] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:54 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:55.247213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:55.249985 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:55.261405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:55.262965 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:55.264691 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:55.265332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:55.500631 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:55.511070 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:55.513354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:55.515805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7030f761-7203-49c9-998d-bf660a98c92c tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1725 microversion: 2.20 time: 0.276205 Jun 15 19:44:55.516639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 378/764] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:55 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 19:44:56.009679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:56.010270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:56.022963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:56.023693 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:56.026218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:56.027198 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:56.228459 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:56.247457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f3dcfd85-bc79-4a02-bf31-48b7d295d1a6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.242627 Jun 15 19:44:56.248676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 387/765] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:56 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:56.537248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:56.538860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:56.553197 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:56.556940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:56.559176 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:56.560031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:56.740226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:56.756776 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:56.763341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:56.767348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c1dfc74f-e683-4583-8717-cd63289f9bfc tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1658 microversion: 2.20 time: 0.234516 Jun 15 19:44:56.772496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 379/766] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:56 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1658 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:56.860917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-0609f655-6346-425a-9589-f90b19768358 req-fb2f3787-43ff-42bc-930d-bca4ee66101f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "name": "network-vif-plugged", "status": "completed", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:56.872924 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-0609f655-6346-425a-9589-f90b19768358 req-fb2f3787-43ff-42bc-930d-bca4ee66101f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:56.873701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-0609f655-6346-425a-9589-f90b19768358 req-fb2f3787-43ff-42bc-930d-bca4ee66101f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:56.895084 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-0609f655-6346-425a-9589-f90b19768358 req-fb2f3787-43ff-42bc-930d-bca4ee66101f service nova] Creating event network-vif-plugged:98860632-f1d4-48e3-a840-1307deb28658 for instance c00cb912-861b-45f1-a2e8-7efe52291be6 on hv-cinder-84456 Jun 15 19:44:56.901756 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-0609f655-6346-425a-9589-f90b19768358 req-fb2f3787-43ff-42bc-930d-bca4ee66101f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047176 Jun 15 19:44:56.903068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 388/767] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:57.181956 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-987df82a-e203-4438-b82c-90c8af9bb9de req-e41c1be7-8670-454d-93cb-c47927010abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d61603-5469-4233-b4a1-95259f1fc06b", "name": "network-vif-deleted", "tag": "e86b7374-75c4-418c-9797-1366945e2805"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:44:57.211086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-987df82a-e203-4438-b82c-90c8af9bb9de req-e41c1be7-8670-454d-93cb-c47927010abe service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:57.212302 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-987df82a-e203-4438-b82c-90c8af9bb9de req-e41c1be7-8670-454d-93cb-c47927010abe service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:57.230823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-987df82a-e203-4438-b82c-90c8af9bb9de req-e41c1be7-8670-454d-93cb-c47927010abe service nova] Creating event network-vif-deleted:e86b7374-75c4-418c-9797-1366945e2805 for instance 29d61603-5469-4233-b4a1-95259f1fc06b on hv-cinder-84456 Jun 15 19:44:57.239789 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-987df82a-e203-4438-b82c-90c8af9bb9de req-e41c1be7-8670-454d-93cb-c47927010abe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073169 Jun 15 19:44:57.241560 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 380/768] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:44:57.275352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:57.277350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:57.286673 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:57.287477 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:57.288588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:57.289432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:57.519009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:57.530166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d361b5da-a5dd-4ac8-bb13-b728d6fb11a1 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.261731 Jun 15 19:44:57.544437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 389/769] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:57 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:57.799467 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:57.800736 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:57.809852 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:57.811864 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:57.813090 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:57.814256 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:57.887990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:57.888869 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:57.889501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lazy-loading 'fault' on Instance uuid 29d61603-5469-4233-b4a1-95259f1fc06b {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:44:57.958833 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:57.968612 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:57.970174 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2103a7ed6824444a60fa5573e7ad39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e0c71509f94f158063991e37617894', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:57.971368 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8af145d2-88c1-4cbd-9638-8a7224c61ca4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 200 len: 1372 microversion: 2.20 time: 0.180091 Jun 15 19:44:57.975354 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 381/770] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:57 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 19:44:58.550260 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:58.550925 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:58.560059 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:58.560589 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:58.561622 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:58.562267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:58.858525 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:44:58.866790 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-68259326-27ae-43d4-a077-c4a0401a471a tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.320628 Jun 15 19:44:58.867420 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 390/771] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:58 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:44:58.991467 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:58.992094 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:58.999270 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:58.999806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:59.000586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:59.001077 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] HTTP exception thrown: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Request method failure captured: Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b HTTP/1.1 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUZegwmjrxP-P3u1YokawXWFb4q-AdLV5EafalPm7g8vA8vTtVNgmXoBrDsyCqLJnOt6uY5srHte-C1IDAsNhL3UxwK4Tt__V5frCnpqsSXxmS-1vndixjeX9A-scbE_43OOF9pRw9wpVmH_YEaZQVjdfLXoruuSo0ZpwF3lM05Jr4 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:44:59.021531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_71e0c71509f94f158063991e37617894", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/71e0c71509f94f158063991e37617894"}]}] Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: b2103a7ed6824444a60fa5573e7ad39e Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:44:59.023231 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '29d61603-5469-4233-b4a1-95259f1fc06b'} Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:44:59.028971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:44:59.031091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:44:59.032418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Returning 404 to user: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:44:59.032418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-676b5308-f387-4b5d-a5c3-fd713ff82ec4 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 404 len: 111 microversion: 2.20 time: 0.034850 Jun 15 19:44:59.032418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 382/772] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:44:58 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 19:44:59.042797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bfb5a771-c4b2-4198-b004-62895b2088c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '.version_select at 0x7f16457373a0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:59.062292 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bfb5a771-c4b2-4198-b004-62895b2088c0 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193245966" status: 204 len: 0 microversion: 2.20 time: 0.023225 Jun 15 19:44:59.063017 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 391/773] 10.222.0.15 () {60 vars in 1261 bytes} [Wed Jun 15 19:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193245966 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 19:44:59.886581 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:44:59.887562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:44:59.896329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:59.897024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:44:59.898038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:44:59.899158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:00.054646 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:00.062494 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2eb397ee-841e-4fb0-942e-398516986ee7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1259 microversion: 2.1 time: 0.180133 Jun 15 19:45:00.063058 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 383/774] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:44:59 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:01.078729 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:01.079549 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:01.087052 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:01.087754 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:01.088534 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:01.088971 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:01.240414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:01.250398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-13106e87-8911-4aa6-bc37-4848ad689515 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1443 microversion: 2.1 time: 0.175526 Jun 15 19:45:01.251347 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 392/775] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:01 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:01.272510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:01.273578 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:01.288110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:01.289582 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:01.291687 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:01.293922 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:01.454662 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:01.462853 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c7626e31-f5f2-41af-ae72-740ddf3843af tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1443 microversion: 2.1 time: 0.198484 Jun 15 19:45:01.463422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 384/776] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:01 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1443 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:02.102585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:02.103206 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:02.115104 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:02.115631 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:02.116430 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:02.116895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:02.136488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] HTTP exception thrown: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Request method failure captured: Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b HTTP/1.1 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUZegwmjrxP-P3u1YokawXWFb4q-AdLV5EafalPm7g8vA8vTtVNgmXoBrDsyCqLJnOt6uY5srHte-C1IDAsNhL3UxwK4Tt__V5frCnpqsSXxmS-1vndixjeX9A-scbE_43OOF9pRw9wpVmH_YEaZQVjdfLXoruuSo0ZpwF3lM05Jr4 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:45:02.140279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_71e0c71509f94f158063991e37617894", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/71e0c71509f94f158063991e37617894"}]}] Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: b2103a7ed6824444a60fa5573e7ad39e Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.142223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '29d61603-5469-4233-b4a1-95259f1fc06b'} Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:45:02.143191 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.146383 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.147732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Returning 404 to user: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:45:02.147732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d120472f-e44e-4c6e-a602-f9ad72efe070 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 404 len: 111 microversion: 2.20 time: 0.044399 Jun 15 19:45:02.147732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 393/777] 10.222.0.15 () {60 vars in 1279 bytes} [Wed Jun 15 19:45:02 2022] DELETE /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:45:02.156539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:02.158123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: 29d61603-5469-4233-b4a1-95259f1fc06b] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:02.167343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:02.168003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:02.169155 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:02.170483 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:02.196170 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] HTTP exception thrown: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Request method failure captured: Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b HTTP/1.1 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUZegwmjrxP-P3u1YokawXWFb4q-AdLV5EafalPm7g8vA8vTtVNgmXoBrDsyCqLJnOt6uY5srHte-C1IDAsNhL3UxwK4Tt__V5frCnpqsSXxmS-1vndixjeX9A-scbE_43OOF9pRw9wpVmH_YEaZQVjdfLXoruuSo0ZpwF3lM05Jr4 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:45:02.199251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_71e0c71509f94f158063991e37617894", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/71e0c71509f94f158063991e37617894"}]}] Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: b2103a7ed6824444a60fa5573e7ad39e Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.200823 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '29d61603-5469-4233-b4a1-95259f1fc06b'} Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:45:02.201584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. Jun 15 19:45:02.202897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:02.204034 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Returning 404 to user: Instance 29d61603-5469-4233-b4a1-95259f1fc06b could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:45:02.204034 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e7e90837-456e-44b5-866d-3b965db3cdda tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b" status: 404 len: 111 microversion: 2.20 time: 0.052860 Jun 15 19:45:02.204034 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 385/778] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:45:02 2022] GET /compute/v2.1/servers/29d61603-5469-4233-b4a1-95259f1fc06b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:45:03.391967 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:03.392488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:03.400019 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:03.400544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:03.401475 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:03.402032 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:03.417837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] HTTP exception thrown: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Request method failure captured: Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 HTTP/1.1 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjUZegwmjrxP-P3u1YokawXWFb4q-AdLV5EafalPm7g8vA8vTtVNgmXoBrDsyCqLJnOt6uY5srHte-C1IDAsNhL3UxwK4Tt__V5frCnpqsSXxmS-1vndixjeX9A-scbE_43OOF9pRw9wpVmH_YEaZQVjdfLXoruuSo0ZpwF3lM05Jr4 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:45:03.419598 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_71e0c71509f94f158063991e37617894", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/71e0c71509f94f158063991e37617894"}]}] Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: b2103a7ed6824444a60fa5573e7ad39e Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.421395 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': 'eadf922d-e2cd-4805-9aee-7157bd242fa9'} Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:45:03.422526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.424015 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.429691 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Returning 404 to user: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:45:03.429691 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cb0f92c2-438a-4542-a13a-00ebd4090746 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 404 len: 111 microversion: 2.20 time: 0.034706 Jun 15 19:45:03.429691 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 394/779] 10.222.0.15 () {60 vars in 1279 bytes} [Wed Jun 15 19:45:03 2022] DELETE /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 19:45:03.434187 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:03.435082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] [instance: eadf922d-e2cd-4805-9aee-7157bd242fa9] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:03.442957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:03.443326 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:03.444086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:03.445038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:03.464842 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] HTTP exception thrown: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Request method failure captured: Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 HTTP/1.1 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjUZegwmjrxP-P3u1YokawXWFb4q-AdLV5EafalPm7g8vA8vTtVNgmXoBrDsyCqLJnOt6uY5srHte-C1IDAsNhL3UxwK4Tt__V5frCnpqsSXxmS-1vndixjeX9A-scbE_43OOF9pRw9wpVmH_YEaZQVjdfLXoruuSo0ZpwF3lM05Jr4 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:45:03.466422 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_71e0c71509f94f158063991e37617894", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/71e0c71509f94f158063991e37617894"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/71e0c71509f94f158063991e37617894"}]}] Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 71e0c71509f94f158063991e37617894 Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446936505 Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: b2103a7ed6824444a60fa5573e7ad39e Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446936505-project Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.468782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'eadf922d-e2cd-4805-9aee-7157bd242fa9'} Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:45:03.469613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. Jun 15 19:45:03.470981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:03.473498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] Returning 404 to user: Instance eadf922d-e2cd-4805-9aee-7157bd242fa9 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:45:03.474597 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1e327757-7c0c-4145-8c5a-0136ffbf08e6 tempest-AttachVolumeShelveTestJSON-1446936505 tempest-AttachVolumeShelveTestJSON-1446936505-project] 10.222.0.15 "GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9" status: 404 len: 111 microversion: 2.20 time: 0.046014 Jun 15 19:45:03.475351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 386/780] 10.222.0.15 () {60 vars in 1276 bytes} [Wed Jun 15 19:45:03 2022] GET /compute/v2.1/servers/eadf922d-e2cd-4805-9aee-7157bd242fa9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 19:45:03.609088 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-34417092-32df-4fb4-9cdb-4e8e0a8744a9 req-d7e54a3b-67be-47f9-8c3d-7c1af7a879b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:03.627449 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-34417092-32df-4fb4-9cdb-4e8e0a8744a9 req-d7e54a3b-67be-47f9-8c3d-7c1af7a879b4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:03.628346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-34417092-32df-4fb4-9cdb-4e8e0a8744a9 req-d7e54a3b-67be-47f9-8c3d-7c1af7a879b4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:03.646955 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-34417092-32df-4fb4-9cdb-4e8e0a8744a9 req-d7e54a3b-67be-47f9-8c3d-7c1af7a879b4 service nova] Creating event network-changed:98860632-f1d4-48e3-a840-1307deb28658 for instance c00cb912-861b-45f1-a2e8-7efe52291be6 on hv-cinder-84456 Jun 15 19:45:03.654949 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-34417092-32df-4fb4-9cdb-4e8e0a8744a9 req-d7e54a3b-67be-47f9-8c3d-7c1af7a879b4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053927 Jun 15 19:45:03.656396 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 395/781] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:08.984346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-88aac16a-cf0f-4b2f-a310-0ee2c32db58a tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Action: 'create', calling method: .version_select at 0x7f1645723550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1822410755", "metadata": {"Type": "work"}}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:09.333155 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-88aac16a-cf0f-4b2f-a310-0ee2c32db58a tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.472338 Jun 15 19:45:09.333773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 387/782] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Jun 15 19:45:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 474 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 19:45:09.345233 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-486f2931-02a7-4a20-981e-5c6a96401a98 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Calling method '.version_select at 0x7f1645778550>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:09.402515 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-486f2931-02a7-4a20-981e-5c6a96401a98 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950" status: 200 len: 353 microversion: 2.1 time: 0.061392 Jun 15 19:45:09.403272 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 396/783] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:45:09 2022] GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:10.415876 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-910dc1ec-e652-4567-bdf1-2e8d1d107c7a tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Calling method '.version_select at 0x7f164575ed30>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:10.472956 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-910dc1ec-e652-4567-bdf1-2e8d1d107c7a tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950" status: 200 len: 354 microversion: 2.1 time: 0.061431 Jun 15 19:45:10.473548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 388/784] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:45:10 2022] GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:10.484709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-888311f9-13fb-4782-87aa-882786f48a24 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Calling method '.version_select at 0x7f16457ed940>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:10.549692 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-888311f9-13fb-4782-87aa-882786f48a24 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950" status: 200 len: 354 microversion: 2.1 time: 0.068825 Jun 15 19:45:10.550310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 397/785] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:45:10 2022] GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:10.566148 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b017f69f-d6b3-4e68-bd43-dfe9ab47a1d3 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Calling method '.version_select at 0x7f1645806790>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:10.630110 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b017f69f-d6b3-4e68-bd43-dfe9ab47a1d3 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950" status: 202 len: 0 microversion: 2.1 time: 0.067801 Jun 15 19:45:10.630704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 389/786] 10.222.0.15 () {58 vars in 1247 bytes} [Wed Jun 15 19:45:10 2022] DELETE /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:45:10.639878 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-180bcbbd-be83-42ed-bcc8-0f3e19a3caa2 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Calling method '.version_select at 0x7f16457069d0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:10.697388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-180bcbbd-be83-42ed-bcc8-0f3e19a3caa2 tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950" status: 200 len: 353 microversion: 2.1 time: 0.062010 Jun 15 19:45:10.698319 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 398/787] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:45:10 2022] GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:11.711351 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c4006b8-41f4-4868-af10-025a03a9a43f tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Calling method '.version_select at 0x7f16457510d0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:11.809300 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-1c4006b8-41f4-4868-af10-025a03a9a43f tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] HTTP exception thrown: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c4006b8-41f4-4868-af10-025a03a9a43f tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Request method failure captured: Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 HTTP/1.1 Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjbEcrR1XwMoibSrNwgWsC6qnNxdEAwZgiqmsspxzA6jqthummOPZ_JbZTDxycS2qHa6QPj6gWk7eUTBezneFDsvBNZ2NJ_6v4aKYNiEZtS2_vdo6RQnbZaxXhcPua4i1hvAkd2q987GG0MEejfiQKUOJY5piU-xhSqLIDQ7rjHuIlU Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 1d29e84f27fa4b709e09489042053c5b Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesGetTestJSON-278520636 Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:45:11.812042 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1d29e84f27fa4b709e09489042053c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1d29e84f27fa4b709e09489042053c5b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1d29e84f27fa4b709e09489042053c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1d29e84f27fa4b709e09489042053c5b"}]}] Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesGetTestJSON-278520636 Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 1d29e84f27fa4b709e09489042053c5b Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesGetTestJSON-278520636 Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesGetTestJSON-278520636-project Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: 51de7a18bcb44a779b633f8db30602ce Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesGetTestJSON-278520636-project Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '5a487359-380c-480a-9841-7abb1700a950'} Jun 15 19:45:11.813563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. (HTTP 404) (Request-ID: req-6ec28eb4-de3a-47ca-9d44-2315f82206d9) Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:11.815356 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 19:45:11.816633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 19:45:11.817820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c4006b8-41f4-4868-af10-025a03a9a43f tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] Returning 404 to user: Volume 5a487359-380c-480a-9841-7abb1700a950 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1c4006b8-41f4-4868-af10-025a03a9a43f tempest-VolumesGetTestJSON-278520636 tempest-VolumesGetTestJSON-278520636-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950" status: 404 len: 109 microversion: 2.1 time: 0.107699 Jun 15 19:45:11.820792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 390/788] 10.222.0.15 () {58 vars in 1244 bytes} [Wed Jun 15 19:45:11 2022] GET /compute/v2.1/os-volumes/5a487359-380c-480a-9841-7abb1700a950 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:45:24.155890 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:24.156651 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:24.160956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-934241596", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "networks": [{"uuid": "034cdc20-4a3d-4dc8-a51c-26294d709eed"}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:24.220573 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] validate_networks() for [('034cdc20-4a3d-4dc8-a51c-26294d709eed', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:45:24.811612 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:45:24.812041 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:45:24.812522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:45:24.812940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:45:24.813356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:45:24.827142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:24.828062 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:24.828874 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:24.829341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:24.849704 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Getting quotas for project aafeedc33991462da96f4c238fe14256. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:45:24.854479 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Getting quotas for user efadf6027540453a975d3dadb3f676c5 and project aafeedc33991462da96f4c238fe14256. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:45:24.867714 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:45:24.870391 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:45:24.920046 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c8c83e0d-9d2e-410b-b783-d6c869d97abd tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765576 Jun 15 19:45:24.921141 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 399/789] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:45:24.932004 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=43 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:24.932995 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=57 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:24.938130 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-807b5c98-6e33-484a-9dd2-2a6e461ef63f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:24.938827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-807b5c98-6e33-484a-9dd2-2a6e461ef63f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:25.020755 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-807b5c98-6e33-484a-9dd2-2a6e461ef63f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:25.029555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-807b5c98-6e33-484a-9dd2-2a6e461ef63f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1213 microversion: 2.1 time: 0.099558 Jun 15 19:45:25.030166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 391/790] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:24 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:45:26.047089 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:26.047761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:26.057940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:26.058434 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:26.059252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:26.059870 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:26.136384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:26.144719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-085fbefe-da3a-404f-882c-a7764d5a653a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1283 microversion: 2.1 time: 0.102279 Jun 15 19:45:26.145299 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 400/791] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:26 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:27.162305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:27.162859 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:27.170601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:27.171048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:27.171827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:27.172259 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:27.311395 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:27.320301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4d778147-aed7-49b6-836e-42bfb6b1e6bb tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.161824 Jun 15 19:45:27.320877 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 392/792] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:27 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:27.373401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-196ec907-7001-4a78-919e-3983dcef33d0 req-bf1d1a7c-e09e-4cd9-af81-d6e3aa2a3fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00680ff-f2f3-4359-a99f-e8813cbe9fd2", "tag": "a8ba6502-c7e6-4390-a3a9-d1586bca2c6d"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:27.390689 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-196ec907-7001-4a78-919e-3983dcef33d0 req-bf1d1a7c-e09e-4cd9-af81-d6e3aa2a3fec service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:27.391142 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-196ec907-7001-4a78-919e-3983dcef33d0 req-bf1d1a7c-e09e-4cd9-af81-d6e3aa2a3fec service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:27.403887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-196ec907-7001-4a78-919e-3983dcef33d0 req-bf1d1a7c-e09e-4cd9-af81-d6e3aa2a3fec service nova] Creating event network-changed:a8ba6502-c7e6-4390-a3a9-d1586bca2c6d for instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 on hv-cinder-84456 Jun 15 19:45:27.408897 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-196ec907-7001-4a78-919e-3983dcef33d0 req-bf1d1a7c-e09e-4cd9-af81-d6e3aa2a3fec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039805 Jun 15 19:45:27.409763 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 401/793] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:28.337346 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:28.338065 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:28.345417 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:28.345865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:28.346661 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:28.347099 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:28.493385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:28.501157 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a6175bc5-508f-4caa-9123-c72d4fd8ac2a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.167743 Jun 15 19:45:28.501713 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 393/794] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:28 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:29.519184 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:29.519894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:29.526385 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:29.526837 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:29.527639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:29.528187 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:29.663286 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:29.671873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a7c9ce6e-859b-4b7d-9969-dec67ebe7c13 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.157392 Jun 15 19:45:29.672606 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 402/795] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:29 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:30.689561 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:30.690206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:30.697008 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:30.697457 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:30.698321 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:30.698895 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:30.899062 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:30.907638 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7457895f-b0e4-46bb-bba9-35631fa6aa43 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.221861 Jun 15 19:45:30.908255 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 394/796] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:30 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:31.924762 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:31.925488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:31.932031 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:31.932485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:31.933266 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:31.933742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:32.075102 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:32.082820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-99fd5b51-0431-432c-9dbf-ca5f39bcf0c4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.161802 Jun 15 19:45:32.083397 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 403/797] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:31 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:33.101094 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:33.101811 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:33.110498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:33.110955 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:33.111757 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:33.112204 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:33.136892 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-b86997ff-2be4-4c8a-8324-f04e12d6c2c0 req-c05beb59-5efe-4e24-aac1-3e3755ae1122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00680ff-f2f3-4359-a99f-e8813cbe9fd2", "name": "network-vif-plugged", "status": "completed", "tag": "a8ba6502-c7e6-4390-a3a9-d1586bca2c6d"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:33.149080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-b86997ff-2be4-4c8a-8324-f04e12d6c2c0 req-c05beb59-5efe-4e24-aac1-3e3755ae1122 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:33.150024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-b86997ff-2be4-4c8a-8324-f04e12d6c2c0 req-c05beb59-5efe-4e24-aac1-3e3755ae1122 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:33.166468 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-b86997ff-2be4-4c8a-8324-f04e12d6c2c0 req-c05beb59-5efe-4e24-aac1-3e3755ae1122 service nova] Creating event network-vif-plugged:a8ba6502-c7e6-4390-a3a9-d1586bca2c6d for instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 on hv-cinder-84456 Jun 15 19:45:33.175861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-b86997ff-2be4-4c8a-8324-f04e12d6c2c0 req-c05beb59-5efe-4e24-aac1-3e3755ae1122 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047070 Jun 15 19:45:33.176918 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 404/798] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:45:33.274848 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:33.283704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a72612de-7f0f-4f43-a6d9-c858c340da23 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.186501 Jun 15 19:45:33.284291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 395/799] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:33 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:45:34.302068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:34.302814 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:34.309920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:34.310460 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:34.311325 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:34.311763 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:34.449296 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:34.456774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-fc729c8c-074f-4c4e-ad18-5df2d40a1f5f tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1313 microversion: 2.1 time: 0.160120 Jun 15 19:45:34.457339 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 405/800] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:34 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:35.473746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:35.474332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:35.476629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:35.481854 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:35.482358 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:35.483151 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:35.483716 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:35.614288 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:35.622603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bb3eb6ff-4649-4df2-814b-97c6de0a9bc2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1497 microversion: 2.1 time: 0.152759 Jun 15 19:45:35.623154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 396/801] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:35 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:38.555900 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:38.556410 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:38.558415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:38.559580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:38.566590 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:38.567059 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:38.567824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:38.568258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:38.593088 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:45:38.673971 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-eb3c87a9-0e17-4167-b8a8-627d555c2676 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 204 len: 0 microversion: 2.1 time: 0.121410 Jun 15 19:45:38.674748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 406/802] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:45:38 2022] DELETE /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:45:38.683981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:38.684586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:38.691570 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:38.691968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:38.692728 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:38.693154 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:38.826038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:38.834073 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-34d61aae-0c13-4250-91f1-328322694774 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.154597 Jun 15 19:45:38.834652 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 397/803] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:38 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:45:39.852326 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:39.853025 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:39.859740 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:39.860185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:39.860946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:39.861374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:39.999341 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:40.007259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-15711bcd-fbaf-4f2e-9436-21f4ada0cc6e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.159592 Jun 15 19:45:40.007844 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 407/804] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:39 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:41.024860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:41.025472 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:41.032688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:41.033137 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:41.033906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:41.034363 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:41.165778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:41.173318 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-07c890d8-adf7-4dcc-8684-bc34be9c423b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.152325 Jun 15 19:45:41.173877 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 398/805] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:41 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:42.191232 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:42.191822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:42.198367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:42.199466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:42.200251 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:42.200682 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:42.334653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:42.342155 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-13cc405c-3738-4c62-8074-09ad48a1b971 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.154719 Jun 15 19:45:42.342732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 408/806] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:42 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:43.359530 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:43.360092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:43.366025 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:43.366841 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:43.367609 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:43.368047 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:43.499648 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:43.507286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-28c64fb2-bc6c-481b-84c4-fd740143cb3e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.152236 Jun 15 19:45:43.507870 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 399/807] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:43 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:45:44.524155 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:44.524776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:44.531485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:44.531933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:44.532700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:44.533161 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:44.666979 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:44.674442 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7628d0e7-3c85-42f4-85d5-f4328137f390 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.154341 Jun 15 19:45:44.675009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 409/808] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:44 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:45.692405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:45.692969 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:45.700465 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:45.700912 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:45.701680 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:45.702131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:45.835222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:45.843169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ef2b2874-a9fe-41ce-9062-0b515015c0a4 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 200 len: 1503 microversion: 2.1 time: 0.154887 Jun 15 19:45:45.843960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 400/809] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:45 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:46.296057 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-fa270f3b-0026-4dc0-b1d5-48ccec2621ce req-b309d847-524d-47d1-a142-cc2bcaa7e961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00680ff-f2f3-4359-a99f-e8813cbe9fd2", "name": "network-vif-deleted", "tag": "a8ba6502-c7e6-4390-a3a9-d1586bca2c6d"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:46.313505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-fa270f3b-0026-4dc0-b1d5-48ccec2621ce req-b309d847-524d-47d1-a142-cc2bcaa7e961 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:46.314229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-fa270f3b-0026-4dc0-b1d5-48ccec2621ce req-b309d847-524d-47d1-a142-cc2bcaa7e961 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:46.337274 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-fa270f3b-0026-4dc0-b1d5-48ccec2621ce req-b309d847-524d-47d1-a142-cc2bcaa7e961 service nova] Creating event network-vif-deleted:a8ba6502-c7e6-4390-a3a9-d1586bca2c6d for instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 on hv-cinder-84456 Jun 15 19:45:46.346931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-fa270f3b-0026-4dc0-b1d5-48ccec2621ce req-b309d847-524d-47d1-a142-cc2bcaa7e961 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058490 Jun 15 19:45:46.347655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 410/810] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:46.860257 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:46.861097 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: c00680ff-f2f3-4359-a99f-e8813cbe9fd2] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:46.868866 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:46.869471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:46.870460 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:46.870952 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:46.895226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] HTTP exception thrown: Instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 could not be found. Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Request method failure captured: Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 HTTP/1.1 Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjbRILaCefv2XJmYuLSydegmWpxklSRCpLBnS-ZW830MSGeYbLoinogHUskS5iyiulIoa8LQozcn8whN_CSji2uklWWOjYtk4LhytmKbifMxIvSgrmn0nRGdEvxYbGyl6MmkUIha_oefoEH6YOmvu8jCTX57wBlsS0uwPjTlLwgisBE Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: aafeedc33991462da96f4c238fe14256 Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesActionsTest-1150135561 Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:45:46.897885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aafeedc33991462da96f4c238fe14256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aafeedc33991462da96f4c238fe14256", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aafeedc33991462da96f4c238fe14256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aafeedc33991462da96f4c238fe14256"}]}] Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesActionsTest-1150135561 Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: aafeedc33991462da96f4c238fe14256 Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesActionsTest-1150135561 Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesActionsTest-1150135561-project Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: efadf6027540453a975d3dadb3f676c5 Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesActionsTest-1150135561-project Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 could not be found. Jun 15 19:45:46.899473 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'c00680ff-f2f3-4359-a99f-e8813cbe9fd2'} Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 could not be found. Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:45:46.900406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 could not be found. Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 could not be found. Jun 15 19:45:46.902294 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:45:46.911203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Returning 404 to user: Instance c00680ff-f2f3-4359-a99f-e8813cbe9fd2 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:45:46.911203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1dcdf749-9860-468c-bab0-d908954f6a10 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2" status: 404 len: 111 microversion: 2.1 time: 0.044024 Jun 15 19:45:46.911203 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 401/811] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:46 2022] GET /compute/v2.1/servers/c00680ff-f2f3-4359-a99f-e8813cbe9fd2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:45:46.959208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2061980731", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452", "networks": [{"uuid": "034cdc20-4a3d-4dc8-a51c-26294d709eed"}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:47.016835 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] validate_networks() for [('034cdc20-4a3d-4dc8-a51c-26294d709eed', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:45:47.397013 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:45:47.397588 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:45:47.397921 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:45:47.398355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:45:47.398767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:45:47.409042 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:47.409473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:47.410305 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:47.411486 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:47.428216 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Getting quotas for project aafeedc33991462da96f4c238fe14256. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:45:47.432166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Getting quotas for user efadf6027540453a975d3dadb3f676c5 and project aafeedc33991462da96f4c238fe14256. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:45:47.444703 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:45:47.447110 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:45:47.495076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6e448736-5b39-4722-8745-6a3ee47369c9 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540418 Jun 15 19:45:47.501709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 411/812] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:45:47.508744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-37839f40-e375-4d75-9f8f-f8decf06267a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:47.508744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-37839f40-e375-4d75-9f8f-f8decf06267a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:47.566924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-37839f40-e375-4d75-9f8f-f8decf06267a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:47.574369 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-37839f40-e375-4d75-9f8f-f8decf06267a tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1214 microversion: 2.1 time: 0.070366 Jun 15 19:45:47.574937 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 402/813] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:47 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:45:48.592116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:48.593686 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:48.605317 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:48.605773 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:48.606678 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:48.607115 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:48.720339 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:48.740428 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b772e1ed-d946-4cbb-a1fc-49a2a7f0855b tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1272 microversion: 2.1 time: 0.144765 Jun 15 19:45:48.742414 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 412/814] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:48 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:49.762561 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:49.763188 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:49.770599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:49.771047 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:49.771806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:49.772241 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:49.907634 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:49.915649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d0d5d8b9-7222-4cad-bb51-4a3435a41ae8 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.157786 Jun 15 19:45:49.916605 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 403/815] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:49 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:50.935135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:50.935752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:50.942150 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:50.942597 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:50.943354 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:50.943782 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:51.071223 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:51.079245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1a97d875-e637-4d2b-8d7d-cd9037064228 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.148996 Jun 15 19:45:51.079807 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 413/816] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:50 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:45:51.368724 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-70f98517-ae51-418f-aec2-2a00c2cef0e3 req-218f58f1-528a-4e8d-ae10-5b09b7a1d480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fac485a-e09e-40bc-932e-4fb4d02b8eba", "tag": "f3f8191a-87d8-4c0c-9123-9ec58cc346ed"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:51.377763 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-70f98517-ae51-418f-aec2-2a00c2cef0e3 req-218f58f1-528a-4e8d-ae10-5b09b7a1d480 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:51.378249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-70f98517-ae51-418f-aec2-2a00c2cef0e3 req-218f58f1-528a-4e8d-ae10-5b09b7a1d480 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:51.389978 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-70f98517-ae51-418f-aec2-2a00c2cef0e3 req-218f58f1-528a-4e8d-ae10-5b09b7a1d480 service nova] Creating event network-changed:f3f8191a-87d8-4c0c-9123-9ec58cc346ed for instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba on hv-cinder-84456 Jun 15 19:45:51.394957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-70f98517-ae51-418f-aec2-2a00c2cef0e3 req-218f58f1-528a-4e8d-ae10-5b09b7a1d480 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030469 Jun 15 19:45:51.395549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 404/817] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:52.096392 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:52.097002 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:52.103673 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:52.104122 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:52.105119 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:52.105593 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:52.249966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:52.258568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-2e766b8e-e095-46e6-a18c-7653228c75d0 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.166094 Jun 15 19:45:52.259163 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 414/818] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:52 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:53.279547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:53.280247 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:53.287917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:53.288741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:53.289484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:53.290075 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:53.428258 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:53.436255 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-95a32adb-3fe1-4631-b22d-705c5181a46e tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.161783 Jun 15 19:45:53.436843 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 405/819] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:53 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:54.452921 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:54.453526 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:54.455945 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:54.461401 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:54.461848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:54.462639 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:54.463071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:54.468581 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:54.603342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:54.611792 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5608d057-624e-45f2-8364-e6884c9c1d76 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.162661 Jun 15 19:45:54.612390 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 415/820] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:54 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:55.629092 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:55.629735 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:55.632228 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=35 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:55.637958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:55.638438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:55.639278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:55.640011 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:55.643375 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=71 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:55.777068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:55.784907 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3676b602-7026-490d-8301-f6389b5fb107 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.159716 Jun 15 19:45:55.785482 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 406/821] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:55 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:56.804896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:56.805644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:56.813896 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:56.814380 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:56.815252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:56.815690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:56.970983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:56.983548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5376b277-1dd9-4980-9777-69b629bb8a26 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.184640 Jun 15 19:45:56.984445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 416/822] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:56 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:57.294264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-d18fde35-eb68-4ad6-89b1-23014984f02f req-d84ed70f-6bb7-48d4-9692-7d093a1a75a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fac485a-e09e-40bc-932e-4fb4d02b8eba", "name": "network-vif-plugged", "status": "completed", "tag": "f3f8191a-87d8-4c0c-9123-9ec58cc346ed"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:45:57.303352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d18fde35-eb68-4ad6-89b1-23014984f02f req-d84ed70f-6bb7-48d4-9692-7d093a1a75a8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:57.303879 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d18fde35-eb68-4ad6-89b1-23014984f02f req-d84ed70f-6bb7-48d4-9692-7d093a1a75a8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:57.316424 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-d18fde35-eb68-4ad6-89b1-23014984f02f req-d84ed70f-6bb7-48d4-9692-7d093a1a75a8 service nova] Creating event network-vif-plugged:f3f8191a-87d8-4c0c-9123-9ec58cc346ed for instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba on hv-cinder-84456 Jun 15 19:45:57.321629 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-d18fde35-eb68-4ad6-89b1-23014984f02f req-d84ed70f-6bb7-48d4-9692-7d093a1a75a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031284 Jun 15 19:45:57.322515 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 407/823] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:45:58.006139 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:58.006765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:58.008641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:58.009296 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:58.015955 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:58.016412 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:58.017204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:58.017646 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:58.159619 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:58.169232 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1125775b-ba35-4849-91e4-122ef4cc1abc tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1314 microversion: 2.1 time: 0.166924 Jun 15 19:45:58.169815 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 417/824] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:58 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:59.185811 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:45:59.221140 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:59.224345 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:59.248249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:59.248928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:59.250852 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:59.251568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:59.473443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:45:59.483837 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5f2f59ea-9aa7-4fb1-91a7-e10fbce39eb1 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1498 microversion: 2.1 time: 0.299997 Jun 15 19:45:59.498897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 408/825] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:45:59 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:45:59.987806 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:45:59.988409 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:45:59.996547 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:59.996977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:45:59.997766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:45:59.998225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:00.036568 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:46:00.346769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-978494b8-406e-4c27-b4f9-bfe439ee6ace tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 204 len: 0 microversion: 2.1 time: 0.363411 Jun 15 19:46:00.347371 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 418/826] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:45:59 2022] DELETE /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:46:00.359179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:00.361000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:00.368285 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:00.368906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:00.369883 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:00.370633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:00.590555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:00.600177 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-295fa8d6-fdb4-429e-b38a-12f7921d15e2 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1504 microversion: 2.1 time: 0.246305 Jun 15 19:46:00.601760 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 409/827] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:00 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:01.628839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:01.630297 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:01.642320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:01.664861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:01.664861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:01.664861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:01.849726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:01.858358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-529b654c-9f6f-414e-8daa-17e065138f22 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1504 microversion: 2.1 time: 0.236248 Jun 15 19:46:01.869644 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 419/828] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:01 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:02.339401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-1acdc9cd-9a81-49f9-9e6d-6aca86f73d5c req-7c020a27-fb3b-4a8c-a76f-7bd9827e474f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fac485a-e09e-40bc-932e-4fb4d02b8eba", "name": "network-vif-deleted", "tag": "f3f8191a-87d8-4c0c-9123-9ec58cc346ed"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:46:02.363872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-1acdc9cd-9a81-49f9-9e6d-6aca86f73d5c req-7c020a27-fb3b-4a8c-a76f-7bd9827e474f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:02.364640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-1acdc9cd-9a81-49f9-9e6d-6aca86f73d5c req-7c020a27-fb3b-4a8c-a76f-7bd9827e474f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:02.389144 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-1acdc9cd-9a81-49f9-9e6d-6aca86f73d5c req-7c020a27-fb3b-4a8c-a76f-7bd9827e474f service nova] Creating event network-vif-deleted:f3f8191a-87d8-4c0c-9123-9ec58cc346ed for instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba on hv-cinder-84456 Jun 15 19:46:02.399183 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-1acdc9cd-9a81-49f9-9e6d-6aca86f73d5c req-7c020a27-fb3b-4a8c-a76f-7bd9827e474f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069236 Jun 15 19:46:02.399902 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 410/829] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:46:02.875787 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:02.876398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:02.884597 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:02.886376 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:02.887288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:02.887940 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:02.939783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:02.940553 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:02.941258 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lazy-loading 'fault' on Instance uuid 1fac485a-e09e-40bc-932e-4fb4d02b8eba {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:46:03.020314 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efadf6027540453a975d3dadb3f676c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafeedc33991462da96f4c238fe14256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:03.037957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-085e702e-9c74-452a-97c9-376eddc88978 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 200 len: 1304 microversion: 2.1 time: 0.165587 Jun 15 19:46:03.038895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 420/830] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:02 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:04.060849 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:04.061655 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] [instance: 1fac485a-e09e-40bc-932e-4fb4d02b8eba] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:04.068865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:04.069396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:04.070347 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:04.070782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:04.085226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] HTTP exception thrown: Instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba could not be found. Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Request method failure captured: Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba HTTP/1.1 Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjbRILaCefv2XJmYuLSydegmWpxklSRCpLBnS-ZW830MSGeYbLoinogHUskS5iyiulIoa8LQozcn8whN_CSji2uklWWOjYtk4LhytmKbifMxIvSgrmn0nRGdEvxYbGyl6MmkUIha_oefoEH6YOmvu8jCTX57wBlsS0uwPjTlLwgisBE Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: aafeedc33991462da96f4c238fe14256 Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesActionsTest-1150135561 Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:46:04.086974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aafeedc33991462da96f4c238fe14256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aafeedc33991462da96f4c238fe14256", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aafeedc33991462da96f4c238fe14256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aafeedc33991462da96f4c238fe14256"}]}] Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesActionsTest-1150135561 Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: aafeedc33991462da96f4c238fe14256 Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesActionsTest-1150135561 Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesActionsTest-1150135561-project Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: efadf6027540453a975d3dadb3f676c5 Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesActionsTest-1150135561-project Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba could not be found. Jun 15 19:46:04.088651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '1fac485a-e09e-40bc-932e-4fb4d02b8eba'} Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba could not be found. Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:46:04.089443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba could not be found. Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba could not be found. Jun 15 19:46:04.091404 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:04.092806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] Returning 404 to user: Instance 1fac485a-e09e-40bc-932e-4fb4d02b8eba could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:46:04.092806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-38512e39-7b70-47f3-89fc-7a4832b60b16 tempest-VolumesActionsTest-1150135561 tempest-VolumesActionsTest-1150135561-project] 10.222.0.15 "GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba" status: 404 len: 111 microversion: 2.1 time: 0.032424 Jun 15 19:46:04.092806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 411/831] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:04 2022] GET /compute/v2.1/servers/1fac485a-e09e-40bc-932e-4fb4d02b8eba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:46:04.746172 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-659483924", "imageRef": "14b903b5-6d82-4bd0-894b-8047434c5ed9", "flavorRef": "452"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:46:04.824070 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] validate_networks() for None {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:46:05.183134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:46:05.183910 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:46:05.184938 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:46:05.185835 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:46:05.186484 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:46:05.200912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:05.201561 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:05.202923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:05.203550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:05.230271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Getting quotas for project 64a686a0b5d04802981b602dceb98804. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:46:05.236464 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Getting quotas for user b65a1f14f9bc46c59214ed240316aa86 and project 64a686a0b5d04802981b602dceb98804. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:46:05.256110 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:46:05.259860 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14b903b5-6d82-4bd0-894b-8047434c5ed9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:46:05.306615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-32920562-9ab5-4cda-be46-2969d8d54c86 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565467 Jun 15 19:46:05.308050 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 421/832] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:46:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:46:05.337158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0c225eed-d10a-4a96-9143-4971ed9308b1 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:05.337744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0c225eed-d10a-4a96-9143-4971ed9308b1 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:05.418454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0c225eed-d10a-4a96-9143-4971ed9308b1 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:05.429758 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0c225eed-d10a-4a96-9143-4971ed9308b1 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1214 microversion: 2.1 time: 0.112512 Jun 15 19:46:05.431147 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 412/833] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:05 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:06.449040 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:06.449786 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:06.456955 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:06.457415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:06.458246 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:06.458688 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:06.523505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:06.532750 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bee0f4fe-ef82-4cf1-883a-26f57f710dc0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1218 microversion: 2.1 time: 0.088587 Jun 15 19:46:06.533552 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 422/834] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:06 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:07.550362 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:07.550990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:07.559790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:07.560250 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:07.561056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:07.561495 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:07.639992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:07.652663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d25e6644-ec07-48cc-b15f-00c6965cfb96 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1210 microversion: 2.1 time: 0.105912 Jun 15 19:46:07.653594 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 413/835] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:07 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:08.670337 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:08.671229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:08.678562 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:08.679471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:08.681039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:08.681900 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:08.761252 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:08.771696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-56caa783-5eec-423d-832b-871ced261da0 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1272 microversion: 2.1 time: 0.105395 Jun 15 19:46:08.772280 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 423/836] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:08 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:09.792538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:09.794320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:09.816748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:09.817217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:09.818030 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:09.822746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:10.091831 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:10.108237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-42d5741e-119d-4cea-b151-97c3f34d4b58 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.323156 Jun 15 19:46:10.109554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 414/837] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:09 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:11.141094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:11.146630 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:11.156024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-58243765-7237-4ea0-b0be-e043c2b82a77 req-97182ed2-6962-4fe1-8ab5-1953d7879a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d34468-199a-4aeb-b9be-c3b5915165a6", "tag": "bcf0eea8-68cc-44cd-9294-1200b9445002"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:46:11.165984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-58243765-7237-4ea0-b0be-e043c2b82a77 req-97182ed2-6962-4fe1-8ab5-1953d7879a00 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:11.166720 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-58243765-7237-4ea0-b0be-e043c2b82a77 req-97182ed2-6962-4fe1-8ab5-1953d7879a00 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:11.190461 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:11.198537 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:11.199764 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-58243765-7237-4ea0-b0be-e043c2b82a77 req-97182ed2-6962-4fe1-8ab5-1953d7879a00 service nova] Creating event network-changed:bcf0eea8-68cc-44cd-9294-1200b9445002 for instance 41d34468-199a-4aeb-b9be-c3b5915165a6 on hv-cinder-84456 Jun 15 19:46:11.204725 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:11.207787 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:11.233655 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-58243765-7237-4ea0-b0be-e043c2b82a77 req-97182ed2-6962-4fe1-8ab5-1953d7879a00 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081721 Jun 15 19:46:11.240750 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 415/838] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:46:11.756488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:11.772687 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0f8bcc86-8271-4cab-8153-89a126269c1f tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.649987 Jun 15 19:46:11.775031 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 424/839] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:11 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:46:12.797801 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:12.798595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:12.825471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:12.826209 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:12.831068 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:12.831813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:13.072583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:13.085378 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-4aaea2e1-2366-4825-8587-17af7fc34a71 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.292073 Jun 15 19:46:13.086664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 416/840] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:12 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:14.110150 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:14.110954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:14.131145 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:14.131724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:14.132889 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:14.133615 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:14.363799 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:14.372556 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5b653f39-6f79-4513-a453-cdebb9c7f493 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.271139 Jun 15 19:46:14.373431 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 425/841] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:14 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:15.393244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:15.394755 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:15.406054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:15.410873 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:15.412326 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:15.413776 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:15.448561 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:46:15.604374 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:15.613632 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8d1089b5-a0c0-4ed0-885a-c5f5a96aae7d tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.224584 Jun 15 19:46:15.624215 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 417/842] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:15 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:16.632522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:16.633351 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:16.639491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:46:16.640523 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=6 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:46:16.643135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:16.643822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:16.645240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:16.645716 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:16.821500 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:16.833354 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-40536ea6-83e0-446d-967d-7a8a63a23b3b tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.204770 Jun 15 19:46:16.833923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 426/843] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:16 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:17.440222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-a7274395-bf74-4ad0-9243-7cd44e1424ce req-5d5ae896-9b9a-452c-9fa4-18cd3a579a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d34468-199a-4aeb-b9be-c3b5915165a6", "name": "network-vif-plugged", "status": "completed", "tag": "bcf0eea8-68cc-44cd-9294-1200b9445002"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:46:17.462777 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-a7274395-bf74-4ad0-9243-7cd44e1424ce req-5d5ae896-9b9a-452c-9fa4-18cd3a579a19 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:17.464218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-a7274395-bf74-4ad0-9243-7cd44e1424ce req-5d5ae896-9b9a-452c-9fa4-18cd3a579a19 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:17.483276 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-a7274395-bf74-4ad0-9243-7cd44e1424ce req-5d5ae896-9b9a-452c-9fa4-18cd3a579a19 service nova] Creating event network-vif-plugged:bcf0eea8-68cc-44cd-9294-1200b9445002 for instance 41d34468-199a-4aeb-b9be-c3b5915165a6 on hv-cinder-84456 Jun 15 19:46:17.503019 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-a7274395-bf74-4ad0-9243-7cd44e1424ce req-5d5ae896-9b9a-452c-9fa4-18cd3a579a19 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070154 Jun 15 19:46:17.504834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 418/844] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:46:17.854672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:17.855473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:17.865076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:17.866430 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:17.867911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:17.868755 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:18.059261 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:18.070495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d54464d8-170a-4c5f-8dde-840af925abc2 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.223237 Jun 15 19:46:18.071899 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 427/845] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:17 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:19.091957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:19.092909 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:19.101832 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:19.102315 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:19.103628 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:19.104065 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:19.342834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:19.362387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5a6f4f5d-3fef-48c7-939a-1a83db392cfc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1314 microversion: 2.1 time: 0.275306 Jun 15 19:46:19.363352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 419/846] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:19 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:20.380234 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:20.381071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:20.387702 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:20.388642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:20.393255 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:20.393255 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:20.641226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:20.651137 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1007d922-0ab2-446a-89a5-da7914e9eabc tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1464 microversion: 2.1 time: 0.274796 Jun 15 19:46:20.651917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 428/847] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:20 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:46:20.710298 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:20.712127 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:20.724744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:20.725770 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:20.727453 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:20.728729 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:20.764502 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:46:20.867117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-98ff8dc0-d9c7-4c5c-9835-e5c5b1771ddd tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "DELETE /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 204 len: 0 microversion: 2.1 time: 0.163389 Jun 15 19:46:20.868009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 420/848] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:46:20 2022] DELETE /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:46:20.877597 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:20.879656 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:20.894894 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:20.895673 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:20.896660 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:20.897267 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:21.195574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:21.206412 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-dcb9f029-4039-453e-8528-449893d67b73 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1470 microversion: 2.1 time: 0.332510 Jun 15 19:46:21.206819 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 429/849] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:20 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1470 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:22.237433 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:22.238166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:22.245420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:22.252660 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:22.254322 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:22.255306 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:22.440624 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65a1f14f9bc46c59214ed240316aa86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a686a0b5d04802981b602dceb98804', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:46:22.458304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1de18d65-3ac3-4491-84c0-fa17cfa4c145 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 200 len: 1470 microversion: 2.1 time: 0.225459 Jun 15 19:46:22.463853 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 421/850] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:22 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:46:22.873457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-0f77d69d-f3be-4184-ba6b-420ddafc1552 req-a7a61fe2-3014-47fb-9638-8d1792a88d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d34468-199a-4aeb-b9be-c3b5915165a6", "name": "network-vif-deleted", "tag": "bcf0eea8-68cc-44cd-9294-1200b9445002"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:46:22.924554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-0f77d69d-f3be-4184-ba6b-420ddafc1552 req-a7a61fe2-3014-47fb-9638-8d1792a88d3a service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:22.926388 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-0f77d69d-f3be-4184-ba6b-420ddafc1552 req-a7a61fe2-3014-47fb-9638-8d1792a88d3a service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:22.951074 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-0f77d69d-f3be-4184-ba6b-420ddafc1552 req-a7a61fe2-3014-47fb-9638-8d1792a88d3a service nova] Creating event network-vif-deleted:bcf0eea8-68cc-44cd-9294-1200b9445002 for instance 41d34468-199a-4aeb-b9be-c3b5915165a6 on hv-cinder-84456 Jun 15 19:46:22.964660 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-0f77d69d-f3be-4184-ba6b-420ddafc1552 req-a7a61fe2-3014-47fb-9638-8d1792a88d3a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102786 Jun 15 19:46:22.973609 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 430/851] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:46:23.479673 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:46:23.480417 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] [instance: 41d34468-199a-4aeb-b9be-c3b5915165a6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:46:23.487345 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:23.487799 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:23.488623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:46:23.489323 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:46:23.511523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] HTTP exception thrown: Instance 41d34468-199a-4aeb-b9be-c3b5915165a6 could not be found. Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Request method failure captured: Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 HTTP/1.1 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjb6wxPa12VdzN0tJbCcF_GoeX-dI1NbhVqJXlaEb4gL1c8nboJEQ6a7KZ5Bomuh9oWZx5arJsg7s_kHD5GIzyzwFGb8HbWKIs6cZI55CiYycOM1lJB9AssQXJTvkDNrlojkjJnTpri8pVwsK1MLjhkrcX5sSGSqRPDt6L6cfaW9868 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: 64a686a0b5d04802981b602dceb98804 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-VolumesNegativeTest-1442863899 Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:46:23.513399 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/64a686a0b5d04802981b602dceb98804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_64a686a0b5d04802981b602dceb98804", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/64a686a0b5d04802981b602dceb98804"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/64a686a0b5d04802981b602dceb98804"}]}] Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-VolumesNegativeTest-1442863899 Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: 64a686a0b5d04802981b602dceb98804 Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-VolumesNegativeTest-1442863899 Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-VolumesNegativeTest-1442863899-project Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: b65a1f14f9bc46c59214ed240316aa86 Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-VolumesNegativeTest-1442863899-project Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 41d34468-199a-4aeb-b9be-c3b5915165a6 could not be found. Jun 15 19:46:23.515246 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '41d34468-199a-4aeb-b9be-c3b5915165a6'} Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d34468-199a-4aeb-b9be-c3b5915165a6 could not be found. Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:46:23.516275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d34468-199a-4aeb-b9be-c3b5915165a6 could not be found. Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d34468-199a-4aeb-b9be-c3b5915165a6 could not be found. Jun 15 19:46:23.517840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:46:23.520498 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] Returning 404 to user: Instance 41d34468-199a-4aeb-b9be-c3b5915165a6 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:46:23.521542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-85e76571-9af4-478e-8373-45cf1aceacf5 tempest-VolumesNegativeTest-1442863899 tempest-VolumesNegativeTest-1442863899-project] 10.222.0.15 "GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6" status: 404 len: 111 microversion: 2.1 time: 0.048539 Jun 15 19:46:23.522682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 422/852] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:46:23 2022] GET /compute/v2.1/servers/41d34468-199a-4aeb-b9be-c3b5915165a6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:46:30.043474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:46:30.044213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:46:43.547009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:46:43.547832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:46:43.951322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ed094b40-69bf-4445-ab8f-7b9a22e0da52 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Action: 'create', calling method: .version_select at 0x7f1645799820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1701459937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW+UTrO0NFW7nTkSyRp+zRMWNzkADKwMj2KSCKhZsxpVBTiFHT7/kIxEmJdA2t2WIRL+6u4XAKe/+W/kSCbBfuz1fdtbMaOFD/19agWxan8yozn7o7RlIWOlOrE5LPSOw=="}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:46:43.990600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-ed094b40-69bf-4445-ab8f-7b9a22e0da52 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'key_pairs'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:46:43.995634 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-ed094b40-69bf-4445-ab8f-7b9a22e0da52 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for user f3eb282e55c941ef9fefb57e14a708f1 and project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'key_pairs'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:46:44.068159 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ed094b40-69bf-4445-ab8f-7b9a22e0da52 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.526919 Jun 15 19:46:44.069346 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 431/853] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:46:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:00.659372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9613160a-a51d-4ccd-b563-d73c893b9c6e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Action: 'create', calling method: .version_select at 0x7f1645885b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-261403087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR70yx2jZe1CYHqRw1FRlOsqVIQhHEifqa7jZXkxgmbSsIr9e2yQwkl+UOWYcaLoUxNy1kfGvISFx/usx/5nyNKlsbZvX657hU+5Zh8GR8zoC6kh2INdcIq9zRu9VQzrw=="}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:00.664341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:00.664986 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:00.678877 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-9613160a-a51d-4ccd-b563-d73c893b9c6e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Getting quotas for project 5eeb6d09ac2a459183dac0e66a26b4bc. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:47:00.682767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-9613160a-a51d-4ccd-b563-d73c893b9c6e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Getting quotas for user 841ccfe45fc64b15b97426ee692deb5b and project 5eeb6d09ac2a459183dac0e66a26b4bc. Resources: {'key_pairs'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:47:00.704593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9613160a-a51d-4ccd-b563-d73c893b9c6e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049044 Jun 15 19:47:00.705189 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 423/854] 10.222.0.15 () {60 vars in 1158 bytes} [Wed Jun 15 19:47:00 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:00.805672 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=4 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:00.807268 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:00.812847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2133868658", "imageRef": "f6bacbe6-268d-4c24-89eb-456b340813e4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-261403087", "networks": [{"uuid": "fa4d081e-86f6-4b0d-9d90-52d503844812"}]}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:00.865177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.network.neutron [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] validate_networks() for [('fa4d081e-86f6-4b0d-9d90-52d503844812', None, None, None, None, None)] {{(pid=129333) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:47:01.191593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-764983512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1701459937", "security_groups": [{"name": "tempest-secgroup-smoke-107218427"}], "block_device_mapping_v2": [{"uuid": "5b492081-be25-4322-a990-7092933b6a3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "027be43c-318b-4ede-b89b-bf032d141bce"}]}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:01.261488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Flavor limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:47:01.261913 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Image limits 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:47:01.262428 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Flavor pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:47:01.262838 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Image pref 0:0:0 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:47:01.263279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.virt.hardware [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129333) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:47:01.274028 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:01.274532 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:01.275411 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:01.275913 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:01.292965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Getting quotas for project 5eeb6d09ac2a459183dac0e66a26b4bc. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:47:01.297116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.quota [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Getting quotas for user 841ccfe45fc64b15b97426ee692deb5b and project 5eeb6d09ac2a459183dac0e66a26b4bc. Resources: {'ram', 'cores', 'instances'} {{(pid=129333) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:47:01.308796 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Going to run 1 instances... {{(pid=129333) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:47:01.311144 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6bacbe6-268d-4c24-89eb-456b340813e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129333) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:47:01.317960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] validate_networks() for [('027be43c-318b-4ede-b89b-bf032d141bce', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:47:01.368939 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-264e8ba1-3fa7-4ee9-b264-126ade6bc6b9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564360 Jun 15 19:47:01.374869 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 432/855] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:47:01.380591 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7de70bb1-de3c-44d7-9eca-e526057f5252 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:01.381219 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7de70bb1-de3c-44d7-9eca-e526057f5252 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:01.452302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7de70bb1-de3c-44d7-9eca-e526057f5252 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:01.461650 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7de70bb1-de3c-44d7-9eca-e526057f5252 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1258 microversion: 2.1 time: 0.085014 Jun 15 19:47:01.462360 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 433/856] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:01 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:01.876836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:47:01.877323 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:47:01.877765 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:47:01.879717 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:47:01.879717 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:47:01.889018 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:01.889458 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:01.890385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:01.890864 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:01.910242 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:47:01.915054 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for user f3eb282e55c941ef9fefb57e14a708f1 and project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:47:01.978169 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:47:01.980531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b492081-be25-4322-a990-7092933b6a3c',volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:47:02.121000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e6786c47-eef6-4c83-aeee-3be1a821e2d7 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.933440 Jun 15 19:47:02.121664 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 424/857] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:47:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 19:47:02.131582 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-daa0d236-e952-4b36-9ab5-5b7a6f67e658 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:02.132439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-daa0d236-e952-4b36-9ab5-5b7a6f67e658 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:02.188365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-daa0d236-e952-4b36-9ab5-5b7a6f67e658 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:02.196863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-daa0d236-e952-4b36-9ab5-5b7a6f67e658 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1094 microversion: 2.1 time: 0.069117 Jun 15 19:47:02.197439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 434/858] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:02 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:02.482678 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:02.483882 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:02.493252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:02.493799 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:02.494632 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:02.495100 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:02.581905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:02.591237 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-19ba1d90-b389-4eec-9acd-e071c03cad3c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1328 microversion: 2.1 time: 0.114228 Jun 15 19:47:02.601111 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 425/859] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:02 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:03.217290 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:03.218715 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:03.227851 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:03.228384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:03.229515 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:03.230374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:03.340037 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:03.349863 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1e1db904-54eb-43f5-b2b5-c411451e6b32 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.139570 Jun 15 19:47:03.362657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 435/860] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:03 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:03.616449 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:03.617178 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:03.635724 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:03.636180 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:03.636967 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:03.637401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:03.798900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:03.807993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3c548c2a-0187-4cd0-a9fb-ea9766c559c5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.203038 Jun 15 19:47:03.809431 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 426/861] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:03 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:04.380847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:04.382218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:04.389784 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:04.390611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:04.391727 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:04.392398 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:04.464166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:04.472861 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f7954cab-b924-4e7d-be8a-9339154854ff tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.095852 Jun 15 19:47:04.474200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 436/862] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:04 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:04.836243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:04.837991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:04.847032 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:04.847805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:04.848771 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:04.849366 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:05.003906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:05.012632 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8e591788-1bd9-4783-a0fb-5d0324d443a3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.181508 Jun 15 19:47:05.013211 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 427/863] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:04 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:05.490320 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:05.492506 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:05.499879 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:05.500726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:05.501769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:05.502653 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:05.570575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:05.580728 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d16f6f84-e5fd-4866-a3f6-7e6511c5b88c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.094951 Jun 15 19:47:05.581498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 437/864] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:05 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:06.032210 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:06.032210 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:06.038626 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:06.039086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:06.039882 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:06.040322 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:06.196355 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:06.205078 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-54a30c75-6639-4b5d-ac0d-f40f67a5d683 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.179949 Jun 15 19:47:06.205942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 428/865] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:06 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:06.597981 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:06.599329 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:06.608473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:06.609265 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:06.610298 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:06.610926 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:06.678032 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:06.686676 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-fab2436f-2af3-4fa9-a866-580bb1d93844 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.092486 Jun 15 19:47:06.687452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 438/866] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:06 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:07.223181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:07.224284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:07.232511 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:07.233055 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:07.233913 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:07.234474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:07.382341 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:07.390880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bc731a35-a9bb-4613-8090-a113d70ba9de tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.172290 Jun 15 19:47:07.391795 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 429/867] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:07 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:07.706746 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:07.707927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:07.714952 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:07.715404 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:07.716185 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:07.716616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:07.780004 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:07.788698 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8d3f0da6-dc42-4506-bedf-f609386b9522 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.086997 Jun 15 19:47:07.798851 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 439/868] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:07 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:08.408267 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:08.408894 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:08.415603 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:08.416059 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:08.416840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:08.417279 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:08.568343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:08.576035 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-11f92145-15a8-4a41-8ac1-a473912f0eb6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.171819 Jun 15 19:47:08.576614 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 430/869] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:08 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:08.805470 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:08.806931 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:08.816655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:08.817113 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:08.817895 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:08.818739 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:08.889641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:08.898322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a4fa34b8-81e5-4a8f-b04b-8c36d00e89b2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.097189 Jun 15 19:47:08.899216 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 440/870] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:08 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:09.145892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:09.146620 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:09.154643 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.155099 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.155885 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.156323 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.183103 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lazy-loading 'flavor' on Instance uuid c00cb912-861b-45f1-a2e8-7efe52291be6 {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:47:09.273916 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-87c473aa-8b2d-4e50-b520-5a2dd2b1e394 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "POST /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6/action" status: 202 len: 0 microversion: 2.1 time: 0.132195 Jun 15 19:47:09.280616 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 431/871] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:47:09 2022] POST /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:47:09.282748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:09.283362 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:09.289945 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.290429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.291207 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.291637 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.454153 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:09.466862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e3abbb70-51a3-4006-b5ae-ad6d686a7fa9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.187814 Jun 15 19:47:09.467542 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 441/872] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:09 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:09.599286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:09.599983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:09.607263 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.607595 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.608654 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.608993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.770862 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:09.782181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f6e1c570-915d-4808-88d8-e4f6ab6cc57a tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.187523 Jun 15 19:47:09.782781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 432/873] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:09 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:09.916390 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:09.919333 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:09.925663 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.926766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.928074 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:09.928519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:09.998374 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:10.009176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b8d98b9e-3266-482c-9796-992c2b0bff7a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.097033 Jun 15 19:47:10.018277 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 442/874] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:09 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:10.484904 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:10.485519 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:10.492843 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:10.493324 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:10.494129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:10.494570 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:10.630825 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:10.639317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8bd88805-3ea6-47cd-8b60-51471397b295 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.158269 Jun 15 19:47:10.639901 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 433/875] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:10 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:10.800466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:10.801116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:10.807906 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:10.808352 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:10.809118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:10.809544 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:10.944242 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:10.955483 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-38d2db4a-ff8f-4b5a-be74-9975d423d499 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.158549 Jun 15 19:47:10.956334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 443/876] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:10 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:11.025831 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:11.026474 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:11.032688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:11.033133 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:11.033900 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:11.034357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:11.097060 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:11.105172 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fb4936ff-1756-4dd3-a1f4-abe6f038f017 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1192 microversion: 2.1 time: 0.083221 Jun 15 19:47:11.105730 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 434/877] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:11 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:11.656981 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:11.657619 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:11.659973 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:11.666808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:11.667257 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:11.668468 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:11.668638 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:11.840036 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:11.847855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-a9598136-75e7-42b0-8838-f777a1b6b318 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.194763 Jun 15 19:47:11.848445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 444/878] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:11 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:11.975610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:11.976281 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:11.978992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:11.979932 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=10 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:11.986782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:11.987226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:11.988017 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:11.988442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:12.122302 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:12.122936 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:12.136080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:12.137026 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:12.138625 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:12.139436 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:12.161990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:12.172082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-9a1c5651-1d1f-47a5-b3cc-44ea81e743d4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.200627 Jun 15 19:47:12.172784 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 435/879] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:11 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:12.193276 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=10 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:12.223771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:12.232093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-3a003b15-2efa-456c-bc1a-91a31ec7fa6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1198 microversion: 2.1 time: 0.113639 Jun 15 19:47:12.233434 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 445/880] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:12 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:12.516773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-415ae401-03dd-4af9-aa05-4b63deb89588 req-203e2fd8-2c87-4da3-9392-9428ba9cea4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:12.525583 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-415ae401-03dd-4af9-aa05-4b63deb89588 req-203e2fd8-2c87-4da3-9392-9428ba9cea4f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:12.526036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-415ae401-03dd-4af9-aa05-4b63deb89588 req-203e2fd8-2c87-4da3-9392-9428ba9cea4f service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:12.538857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-415ae401-03dd-4af9-aa05-4b63deb89588 req-203e2fd8-2c87-4da3-9392-9428ba9cea4f service nova] Creating event network-changed:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:47:12.544317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-415ae401-03dd-4af9-aa05-4b63deb89588 req-203e2fd8-2c87-4da3-9392-9428ba9cea4f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031252 Jun 15 19:47:12.545542 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 436/881] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:12.865452 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:12.866314 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:12.872636 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:12.873097 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:12.873887 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:12.874357 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:13.033977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:13.043032 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-75203241-b326-422c-9a1a-9c9674e4210d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.182003 Jun 15 19:47:13.052933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 446/882] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:12 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:13.190253 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:13.191045 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:13.198531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:13.199221 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:13.200031 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:13.200464 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:13.252585 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:13.253366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:13.261985 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:13.262527 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:13.263416 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:13.263953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:13.400007 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:13.413565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8a0231f6-3c14-4ac9-87ee-eeb6c603112f tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.227841 Jun 15 19:47:13.421915 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 437/883] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:13 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:13.446262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:13.454060 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ab553cff-9228-43ea-92fd-7672644df5c6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.206165 Jun 15 19:47:13.454670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 447/884] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:13 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:14.061877 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:14.062586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:14.069170 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.069622 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.070425 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.070857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.213556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:14.221333 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d83ad59c-27a4-48bf-845b-0cd4d39958ff tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.163421 Jun 15 19:47:14.221924 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 438/885] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:14 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:14.433105 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:14.433771 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:14.441482 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.441932 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.442737 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.443166 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.471129 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:14.471897 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:14.478298 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.478748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.479525 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.480143 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.641026 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:14.648966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-05201180-5160-4284-a9ac-ef004e61529b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.221336 Jun 15 19:47:14.649747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 448/886] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:14 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:14.664104 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-17397405-2f97-4df1-995f-e8b3aee63b0b req-4b02a4e4-088f-4e16-b8bb-5f83e2cbb95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c741e5-dd61-47bd-9d45-7a33d5f0eb6c", "tag": "0a4b2324-33cc-4785-a82e-68b01b7613ed"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:14.674140 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:14.677699 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:14.683157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-17397405-2f97-4df1-995f-e8b3aee63b0b req-4b02a4e4-088f-4e16-b8bb-5f83e2cbb95d service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:14.683600 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-17397405-2f97-4df1-995f-e8b3aee63b0b req-4b02a4e4-088f-4e16-b8bb-5f83e2cbb95d service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:14.689088 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1da76af1-3fae-44c4-8443-a0003db29a23 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.221906 Jun 15 19:47:14.689684 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 439/887] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:14 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:14.699345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-17397405-2f97-4df1-995f-e8b3aee63b0b req-4b02a4e4-088f-4e16-b8bb-5f83e2cbb95d service nova] Creating event network-changed:0a4b2324-33cc-4785-a82e-68b01b7613ed for instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c on hv-cinder-84456 Jun 15 19:47:14.704749 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-17397405-2f97-4df1-995f-e8b3aee63b0b req-4b02a4e4-088f-4e16-b8bb-5f83e2cbb95d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044504 Jun 15 19:47:14.705954 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 449/888] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:15.239692 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:15.240342 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:15.248298 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:15.248753 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:15.249537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:15.249975 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:15.390066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:15.398663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5fcee07e-3fde-4c10-9724-457c0d738d37 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.163600 Jun 15 19:47:15.399350 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 440/889] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:15 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:15.668098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:15.668827 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:15.679317 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:15.679766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:15.680574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:15.681004 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:15.706264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:15.706871 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:15.714565 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:15.715343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:15.716284 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:15.716720 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:15.897592 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:15.905514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bc237988-743a-47ff-88c2-7647a934ef9e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.242845 Jun 15 19:47:15.906118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 450/890] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:15 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:15.907150 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:15.920520 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-613b499d-ecae-486c-9934-8e61ba931ddf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.218007 Jun 15 19:47:15.921034 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 441/891] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:15 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:16.418446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:16.419061 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:16.425455 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:16.425912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:16.426730 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:16.427167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:16.565492 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:16.570195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=100 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:16.575724 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ec1c970d-ac64-49c8-8f97-86669b4a3239 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.161125 Jun 15 19:47:16.576457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 451/892] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:16 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:16.922715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:16.923324 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:16.930570 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:16.931012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:16.931787 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:16.932217 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:16.939268 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:16.939906 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:16.946774 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:16.947235 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:16.948002 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:16.948431 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:17.138227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:17.145865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8f2e01cc-1e9f-4964-a1f5-aae7ae36bbe3 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.226883 Jun 15 19:47:17.146477 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 442/893] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:16 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:17.152999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:17.160663 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1936ee47-ba93-4f1c-83ef-997614eccbe1 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.225361 Jun 15 19:47:17.161255 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 452/894] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:16 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:17.592994 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:17.593607 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:17.599993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:17.600442 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:17.601213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:17.601641 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:17.743397 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:17.751420 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-99b4ff53-dc9c-4b9d-b0d9-570bac1eaa86 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.162364 Jun 15 19:47:17.752002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 443/895] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:17 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:18.163779 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:18.164367 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:18.171035 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.171478 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.172244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.172674 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.179196 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:18.179806 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:18.186391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.186834 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.187600 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.188027 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.384962 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:18.388041 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:18.395024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-014986ba-b0c5-452f-9505-47440165af55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.234820 Jun 15 19:47:18.396249 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 453/896] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:18 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:18.406898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-fa11951b-45ec-4642-8e5c-7b82ccdffe67 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.232205 Jun 15 19:47:18.407579 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 444/897] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:18 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:18.648359 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-1b08e46c-91a2-4989-b25f-1cb4c9b2bbd2 req-a19d304c-e571-4958-af98-2dc6413e4418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "name": "network-vif-plugged", "status": "completed", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:18.656790 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1b08e46c-91a2-4989-b25f-1cb4c9b2bbd2 req-a19d304c-e571-4958-af98-2dc6413e4418 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.657236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1b08e46c-91a2-4989-b25f-1cb4c9b2bbd2 req-a19d304c-e571-4958-af98-2dc6413e4418 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.670177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-1b08e46c-91a2-4989-b25f-1cb4c9b2bbd2 req-a19d304c-e571-4958-af98-2dc6413e4418 service nova] Creating event network-vif-plugged:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:47:18.677167 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-1b08e46c-91a2-4989-b25f-1cb4c9b2bbd2 req-a19d304c-e571-4958-af98-2dc6413e4418 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Jun 15 19:47:18.677775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 454/898] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:47:18.770212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:18.771036 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:18.778942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.779538 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.781264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:18.781716 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:18.934017 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:18.941633 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-253ebe46-7b3a-407b-9a0e-e9215d5e6e98 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.176291 Jun 15 19:47:18.942228 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 445/899] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:18 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:19.414011 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:19.414742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:19.421284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:19.421735 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:19.422545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:19.422982 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:19.424502 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:19.425111 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:19.432184 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:19.432775 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:19.433548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:19.434060 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:19.636448 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:19.641184 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:19.645524 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ee62011f-3948-457b-ab90-697654697fd4 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1358 microversion: 2.1 time: 0.236226 Jun 15 19:47:19.646134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 455/900] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:19 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:19.649123 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6d88564c-881f-4f53-a21a-8287caee754b tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.228680 Jun 15 19:47:19.649694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 446/901] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:19 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:19.959331 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:19.959883 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:19.966081 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:19.966518 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:19.967281 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:19.967714 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:20.107773 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:20.116256 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5fe90fdc-0e2d-40dc-81b3-f70e212d7bb0 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.160274 Jun 15 19:47:20.116826 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 456/902] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:19 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:20.662655 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:20.663212 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:20.665497 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:20.666307 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:20.670302 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:20.670747 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:20.671515 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:20.671951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:20.672862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:20.673310 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:20.674129 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:20.674575 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:20.872173 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:20.876892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:20.879803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c8ae8023-3200-400d-8db9-652faced8bcb tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.218240 Jun 15 19:47:20.880379 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 457/903] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:20 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:20.890002 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3198e58d-d9d6-4b19-ac1c-2d178010a3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1549 microversion: 2.1 time: 0.231310 Jun 15 19:47:20.890715 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 447/904] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:20 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1549 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:20.907436 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:20.908044 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:20.914618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:20.914999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:20.915769 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:20.916203 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.058378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:21.066068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ace1dc8e-8d13-4e73-b6f8-d67ee6e153f8 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1549 microversion: 2.1 time: 0.162683 Jun 15 19:47:21.066670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 458/905] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:20 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:21.082391 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:21.085792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:21.086580 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Searching by: {'deleted': False, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc'} {{(pid=129334) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 19:47:21.093484 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.093927 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.094820 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.095251 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.133677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:21.134415 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:21.140495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.140947 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.141730 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.142190 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.187625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.multi_cell_list [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129334) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 19:47:21.278119 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:21.286024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-73c06f96-d635-45bb-8b61-982cb6f4b3e9 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.156736 Jun 15 19:47:21.289366 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 459/906] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:21 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:21.289531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cbb1fe31-29d2-4aff-801b-da69e88262f5 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208858 Jun 15 19:47:21.289531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 448/907] 10.222.0.15 () {58 vars in 1124 bytes} [Wed Jun 15 19:47:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:21.298618 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:21.299231 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:21.306009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.306496 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.307271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.307701 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.448923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:21.456862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4558cfa1-6ae2-4556-bb8e-dd63f6d22476 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1549 microversion: 2.1 time: 0.161958 Jun 15 19:47:21.457439 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 460/908] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:21 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:21.897556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:21.898296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:21.905205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.905953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:21.906767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:21.907205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:22.041632 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:22.049489 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-60de3e50-8aef-42b4-9d53-0c501febb810 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.156387 Jun 15 19:47:22.050067 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 449/909] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:21 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:22.303855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:22.304463 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:22.311386 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:22.311843 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:22.312654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:22.313094 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:22.459429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:22.470453 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c9f19379-eab1-4ddb-aeba-c06f6fef06a8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.170245 Jun 15 19:47:22.471179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 461/910] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:22 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:23.006579 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2"}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:23.007863 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:23.014504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:23.014957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:23.015731 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:23.016170 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:23.065226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:23.066039 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:23.072390 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:23.072916 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:23.073920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:23.074323 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:23.387996 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-941de51e-e5c7-415c-a474-26f391dae72e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384948 Jun 15 19:47:23.388707 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 450/911] 10.222.0.15 () {60 vars in 1322 bytes} [Wed Jun 15 19:47:23 2022] POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:23.477465 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:23.487137 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-309487d5-9ddb-4f9b-a6c3-768f5c3e5069 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.425692 Jun 15 19:47:23.488264 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 462/912] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:23 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:23.488387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:23.489371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:23.496331 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:23.496977 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:23.497755 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:23.498213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:23.643079 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:23.651624 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b5358e1b-f2e5-40a6-9df7-bdb9ce77ff8d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.167339 Jun 15 19:47:23.652332 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 451/913] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:23 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:24.506746 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:24.507915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:24.516126 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.516574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.517350 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.517782 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.661160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:24.669557 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4e2c03b2-f07d-436f-befc-fc8c0ab7ba42 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.168067 Jun 15 19:47:24.670157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 463/914] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:24 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:24.670929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:24.671551 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:24.679527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.680000 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.680781 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.681219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.822753 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:24.829776 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-db14fa41-cd15-4d7b-bda9-6e7e3bae40b7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1509 microversion: 2.1 time: 0.162942 Jun 15 19:47:24.830419 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 452/915] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:24 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:24.847462 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:24.848029 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:24.854803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.855177 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.855955 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.856381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.937290 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-4e742f4b-e890-49fc-b574-a7d869b53baf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "POST /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6/action" status: 202 len: 0 microversion: 2.1 time: 0.093815 Jun 15 19:47:24.938250 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 464/916] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:47:24 2022] POST /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:47:24.946432 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:24.947337 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:24.954735 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.955193 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:24.955958 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:24.956393 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:25.111466 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:25.120014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-c1edd9e1-24a5-41b4-a888-1b396e0b1af3 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1517 microversion: 2.1 time: 0.177505 Jun 15 19:47:25.120596 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 453/917] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:24 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:25.688684 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:25.689355 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:25.697262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:25.697718 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:25.698620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:25.698988 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:25.907322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:25.915522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-010250cf-51a9-4cf5-ad39-b900ee89cb2f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.233566 Jun 15 19:47:25.916093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 465/918] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:25 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:26.137166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:26.137799 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:26.144414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:26.144865 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:26.145640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:26.146077 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:26.283911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:26.288038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:26.292953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-664f8e66-6148-4d55-a8e2-10abe1805706 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1519 microversion: 2.1 time: 0.159767 Jun 15 19:47:26.293529 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 454/919] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:26 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:26.562351 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-ef7214c9-0a9f-458d-b352-88cb4f571a54 req-f19c2d46-7cc7-4748-8064-563834fb4c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c741e5-dd61-47bd-9d45-7a33d5f0eb6c", "name": "network-vif-plugged", "status": "completed", "tag": "0a4b2324-33cc-4785-a82e-68b01b7613ed"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:26.571308 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-ef7214c9-0a9f-458d-b352-88cb4f571a54 req-f19c2d46-7cc7-4748-8064-563834fb4c29 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:26.571767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-ef7214c9-0a9f-458d-b352-88cb4f571a54 req-f19c2d46-7cc7-4748-8064-563834fb4c29 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:26.584953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-ef7214c9-0a9f-458d-b352-88cb4f571a54 req-f19c2d46-7cc7-4748-8064-563834fb4c29 service nova] Creating event network-vif-plugged:0a4b2324-33cc-4785-a82e-68b01b7613ed for instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c on hv-cinder-84456 Jun 15 19:47:26.590441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-ef7214c9-0a9f-458d-b352-88cb4f571a54 req-f19c2d46-7cc7-4748-8064-563834fb4c29 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Jun 15 19:47:26.591057 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 466/920] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:26.932899 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:26.933504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:26.940544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:26.940993 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:26.941762 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:26.942235 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:27.078371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:27.085938 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-dd1490ec-be2e-4a34-8844-82ebc7472e7d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1265 microversion: 2.1 time: 0.156936 Jun 15 19:47:27.086558 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 455/921] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:26 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:27.311854 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:27.312547 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:27.318822 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:27.319266 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:27.320024 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:27.320637 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:27.459135 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:27.466944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cbe5bd2d-646e-4898-9dfe-b4533e5d40b8 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1519 microversion: 2.1 time: 0.159712 Jun 15 19:47:27.467519 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 467/922] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:27 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:28.102733 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:28.103438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:28.110585 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.111028 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.111792 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.112226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.256453 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:28.264064 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b0a07b15-a6df-4363-ab26-f47673b1d24f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1452 microversion: 2.1 time: 0.165155 Jun 15 19:47:28.264640 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 456/923] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:28 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:28.280671 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:28.281275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:28.287460 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.287901 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.288670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.289289 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.427188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:28.431616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:28.436977 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-22298647-0c58-40fa-b62a-6ea23ff50250 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1452 microversion: 2.1 time: 0.160081 Jun 15 19:47:28.437655 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 468/924] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:28 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:28.484536 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:28.485137 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:28.492651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.493104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.493878 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.494343 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.618353 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-4826d17a-9288-4bf2-a225-d6409d00f683 req-5948021f-62a7-4811-b3cc-e89a6e111820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "name": "network-vif-unplugged", "status": "completed", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:28.631437 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-4826d17a-9288-4bf2-a225-d6409d00f683 req-5948021f-62a7-4811-b3cc-e89a6e111820 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:28.631886 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-4826d17a-9288-4bf2-a225-d6409d00f683 req-5948021f-62a7-4811-b3cc-e89a6e111820 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:28.644860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:28.645362 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.compute.server_external_events [req-4826d17a-9288-4bf2-a225-d6409d00f683 req-5948021f-62a7-4811-b3cc-e89a6e111820 service nova] Unable to find a host for instance c00cb912-861b-45f1-a2e8-7efe52291be6. Dropping event network-vif-unplugged {{(pid=129333) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 19:47:28.646336 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-4826d17a-9288-4bf2-a225-d6409d00f683 req-5948021f-62a7-4811-b3cc-e89a6e111820 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036470 Jun 15 19:47:28.647264 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 469/925] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 19:47:28.656784 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-348ccf44-2fcf-404d-a063-0d17c3025f83 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1519 microversion: 2.1 time: 0.175712 Jun 15 19:47:28.657513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 457/926] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:28 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:29.675098 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:29.675783 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:29.681776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:29.685742 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:29.686218 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:29.687009 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:29.687454 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:29.860188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:29.870134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e58d8b22-32a0-47eb-8969-a774ef1e6cdc tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1519 microversion: 2.1 time: 0.199179 Jun 15 19:47:29.874384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 470/927] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:29 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:29.977641 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:29.978286 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:29.985097 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:29.985547 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:29.986409 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:29.986813 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:30.144716 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:30.156272 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-eef7ce29-0006-4903-8a7a-799f1d7c30c1 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1595 microversion: 2.1 time: 0.183122 Jun 15 19:47:30.170479 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 458/928] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:29 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1595 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:30.595752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-647bfea9-6823-4b60-b892-29ed7fcaa9ae req-f9229693-0db3-4e41-96bd-53224bbbd87d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c741e5-dd61-47bd-9d45-7a33d5f0eb6c", "tag": "0a4b2324-33cc-4785-a82e-68b01b7613ed"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:30.604674 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-647bfea9-6823-4b60-b892-29ed7fcaa9ae req-f9229693-0db3-4e41-96bd-53224bbbd87d service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:30.605426 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-647bfea9-6823-4b60-b892-29ed7fcaa9ae req-f9229693-0db3-4e41-96bd-53224bbbd87d service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:30.617432 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-647bfea9-6823-4b60-b892-29ed7fcaa9ae req-f9229693-0db3-4e41-96bd-53224bbbd87d service nova] Creating event network-changed:0a4b2324-33cc-4785-a82e-68b01b7613ed for instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c on hv-cinder-84456 Jun 15 19:47:30.623835 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-647bfea9-6823-4b60-b892-29ed7fcaa9ae req-f9229693-0db3-4e41-96bd-53224bbbd87d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031375 Jun 15 19:47:30.625051 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 471/929] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:30.892685 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:30.893725 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:30.901371 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:30.904080 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:30.905500 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:30.906667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:30.907620 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:31.126268 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:31.157038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:31.167033 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-47c15bd3-4782-4569-b03a-c0042cb56bda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.280163 Jun 15 19:47:31.178166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 459/930] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:30 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:32.151673 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-27c6b595-fd4b-4d78-ad19-d1b8886694a8 req-913096f6-a7a9-46dc-9c74-4e4087f173d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:32.163145 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-27c6b595-fd4b-4d78-ad19-d1b8886694a8 req-913096f6-a7a9-46dc-9c74-4e4087f173d4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:32.163698 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-27c6b595-fd4b-4d78-ad19-d1b8886694a8 req-913096f6-a7a9-46dc-9c74-4e4087f173d4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:32.175850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-27c6b595-fd4b-4d78-ad19-d1b8886694a8 req-913096f6-a7a9-46dc-9c74-4e4087f173d4 service nova] Creating event network-changed:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:47:32.181801 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-27c6b595-fd4b-4d78-ad19-d1b8886694a8 req-913096f6-a7a9-46dc-9c74-4e4087f173d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034080 Jun 15 19:47:32.185533 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 472/931] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:32.190456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:32.191663 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:32.199221 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:32.199985 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:32.201051 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:32.201682 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:32.364361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:32.377014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a699815e-6f74-4a73-98f5-20b590bf9059 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.190798 Jun 15 19:47:32.377608 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 460/932] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:32 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:33.379165 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1416027551"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:33.379866 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:33.386396 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:33.386927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:33.388244 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:33.388855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:33.395197 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:33.396528 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:33.404336 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:33.405221 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:33.406117 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:33.406744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:33.587890 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.network.security_group_api [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Adding security group 7460d356-0aa1-4382-beeb-f3ea4b777bb5 to port 1d0b45aa-c70d-4006-b056-768daf2e3807 Jun 15 19:47:33.637895 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:33.649249 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-218af0b0-f6ff-4aa4-8ad8-0cc9c626213d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.258630 Jun 15 19:47:33.650072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 461/933] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:33 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:33.986045 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7243b45a-cc22-455c-9765-23e1edbc2c3d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/action" status: 202 len: 0 microversion: 2.1 time: 0.611726 Jun 15 19:47:33.988464 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 473/934] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:47:33 2022] POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:47:33.996593 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:33.997205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:34.009257 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:34.010238 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:34.011385 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:34.012038 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:34.175096 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:34.183511 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bef73d39-cc7c-4932-bba8-419d1a00ab12 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1761 microversion: 2.1 time: 0.190621 Jun 15 19:47:34.184370 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 462/935] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:33 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1761 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:34.202190 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-a1ae5f44-1867-4666-b1ef-e0cb2b561ca0 req-793bb09e-860b-43dd-93d8-3efc366beb94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:34.211118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-a1ae5f44-1867-4666-b1ef-e0cb2b561ca0 req-793bb09e-860b-43dd-93d8-3efc366beb94 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:34.211569 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-a1ae5f44-1867-4666-b1ef-e0cb2b561ca0 req-793bb09e-860b-43dd-93d8-3efc366beb94 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:34.225602 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-a1ae5f44-1867-4666-b1ef-e0cb2b561ca0 req-793bb09e-860b-43dd-93d8-3efc366beb94 service nova] Creating event network-changed:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:47:34.230946 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-a1ae5f44-1867-4666-b1ef-e0cb2b561ca0 req-793bb09e-860b-43dd-93d8-3efc366beb94 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032454 Jun 15 19:47:34.231629 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 474/936] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:34.667618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:34.668215 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:34.675043 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:34.675504 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:34.676280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:34.677434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:34.829709 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:34.843584 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-8ace1ad0-fd71-427c-a6ad-4b9366c6c368 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.180030 Jun 15 19:47:34.844707 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 463/937] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:34 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:35.862623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:35.863236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:35.870405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:35.870854 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:35.871625 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:35.872061 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:36.015343 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:36.024109 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cb08d32c-de99-4626-8c6c-c8469967d074 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.166246 Jun 15 19:47:36.024692 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 475/938] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:35 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:37.041226 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:37.041836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:37.048698 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:37.049148 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:37.049951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:37.050397 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:37.191408 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:37.199657 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-be73bd56-09a0-4347-8371-1f6e5f9702d7 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.162736 Jun 15 19:47:37.200239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 464/939] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:37 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:38.218368 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:38.218908 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:38.227118 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:38.227562 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:38.228326 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:38.228912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:38.378375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:38.386748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cc5189bf-8bce-4cc6-8c57-0ac1cb3bcb48 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.172716 Jun 15 19:47:38.387303 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 476/940] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:38 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:39.403091 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:39.403702 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:39.410732 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:39.411181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:39.411961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:39.413086 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:39.558587 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:39.566523 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bfefdd2a-054a-4cd3-b045-35d4c98333ae tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.167196 Jun 15 19:47:39.567106 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 465/941] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:39 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:40.583959 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:40.585179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:40.592035 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:40.592511 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:40.593312 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:40.593748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:40.734935 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:40.743275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-188888a0-afc9-4cba-a5bb-d438c5a1c3c6 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.163288 Jun 15 19:47:40.743778 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 477/942] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:40 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:41.760304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:41.760905 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:41.766911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:41.767352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:41.768109 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:41.768532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:41.903667 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:41.911378 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1f017907-18f0-48fb-890d-c692cc71633e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.155591 Jun 15 19:47:41.911950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 466/943] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:41 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:42.632345 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-db0b5ecb-8b5d-427f-ac81-f74e4a361c22 req-1c04375b-d6c4-4f19-9afc-6c04537f0660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "name": "network-vif-plugged", "status": "completed", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:42.641616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-db0b5ecb-8b5d-427f-ac81-f74e4a361c22 req-1c04375b-d6c4-4f19-9afc-6c04537f0660 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:42.642047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-db0b5ecb-8b5d-427f-ac81-f74e4a361c22 req-1c04375b-d6c4-4f19-9afc-6c04537f0660 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:42.654793 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-db0b5ecb-8b5d-427f-ac81-f74e4a361c22 req-1c04375b-d6c4-4f19-9afc-6c04537f0660 service nova] Creating event network-vif-plugged:98860632-f1d4-48e3-a840-1307deb28658 for instance c00cb912-861b-45f1-a2e8-7efe52291be6 on hv-cinder-84456 Jun 15 19:47:42.661427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-db0b5ecb-8b5d-427f-ac81-f74e4a361c22 req-1c04375b-d6c4-4f19-9afc-6c04537f0660 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Jun 15 19:47:42.661427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 478/944] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:47:42.928950 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:42.929716 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:42.936577 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:42.937024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:42.937788 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:42.938261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:43.085623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:43.093264 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-11d81c3d-78e0-4c61-a467-dae88002f48c tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.168350 Jun 15 19:47:43.093840 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 467/945] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:42 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:44.110708 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:44.111430 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:44.118736 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:44.119180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:44.119935 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:44.120370 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:44.259001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:44.266689 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8ffaf8e0-3810-4332-86f5-80abcaa940ea tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1575 microversion: 2.1 time: 0.160825 Jun 15 19:47:44.267259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 479/946] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:44 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:45.283738 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:45.284360 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:45.291334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:45.291773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:45.292527 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:45.292954 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:45.434357 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:45.441990 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-cb12a3a3-c656-4e1d-b0ef-93a4a77e4cda tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1562 microversion: 2.1 time: 0.162058 Jun 15 19:47:45.442621 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 468/947] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:45 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:56.716884 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:47:56.717820 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:56.720498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=18 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:56.721168 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=44 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:56.727576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:56.728034 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:56.728812 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:56.729249 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:56.808545 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-221d1ace-2c12-4d0c-aa74-e8a6406e25b2 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/action" status: 202 len: 0 microversion: 2.1 time: 0.095588 Jun 15 19:47:56.809205 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 480/948] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:47:56 2022] POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:47:56.818158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:56.818920 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:56.821358 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=19 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:56.821987 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=84 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:47:56.827971 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:56.828423 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:56.829205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:56.829689 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:57.047849 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:57.055860 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-bb42275c-9c0b-47d8-99ce-8d0069624323 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1753 microversion: 2.1 time: 0.241581 Jun 15 19:47:57.056438 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 469/949] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:56 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1753 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:47:58.074204 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:58.074903 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:58.081465 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:58.081909 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:58.082699 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:58.083134 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:58.281053 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:58.289752 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-789819f2-8564-41fa-b648-a6d73943c127 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.220194 Jun 15 19:47:58.290342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 481/950] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:58 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:47:59.311639 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:47:59.312615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:47:59.321105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:59.321549 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:59.322372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:47:59.322805 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:47:59.476071 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:47:59.484779 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b1299083-db7b-4a0d-bcc7-651a3488294c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.179352 Jun 15 19:47:59.485373 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 470/951] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:47:59 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:00.503078 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:00.503690 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:00.511170 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:00.511623 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:00.512408 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:00.512847 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:00.660772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:00.669151 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0558ba56-521f-4324-824a-4c8a7cd76242 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.170002 Jun 15 19:48:00.669731 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 482/952] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:00 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:01.687158 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:01.687769 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:01.695758 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:01.696208 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:01.697001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:01.697423 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:01.847580 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:01.855855 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-e9195b3f-84d0-4133-a283-c1a3a6b7a727 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.172714 Jun 15 19:48:01.856434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 471/953] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:01 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:02.873231 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:02.873842 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:02.881209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:02.882413 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:02.883179 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:02.883610 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:03.033927 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:03.043042 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-80ee766c-8faa-4c76-b2fc-5e519d1d2f55 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.173690 Jun 15 19:48:03.043617 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 483/954] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:02 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:04.060508 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:04.061105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:04.067631 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:04.068153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:04.068911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:04.069405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:04.227804 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:04.236113 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-f26a906b-7ae2-43ad-be8f-82198de9d361 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.179409 Jun 15 19:48:04.236702 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 472/955] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:04 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:05.254457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:05.255072 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:05.262363 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:05.262807 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:05.263571 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:05.264002 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:05.414606 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:05.423299 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5e8b50e2-ebc6-47cc-8ac0-6d79e21aacd9 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.172775 Jun 15 19:48:05.423872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 484/956] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:05 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:06.442785 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:06.443388 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:06.450302 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:06.450746 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:06.451513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:06.451946 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:06.611027 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:06.619695 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-083ad180-9f5a-4deb-af95-dda34d77e22e tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.180744 Jun 15 19:48:06.620361 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 473/957] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:06 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:07.636709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:07.637327 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:07.644092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:07.644546 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:07.645317 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:07.645753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:08.023087 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:08.030916 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-45f44d11-d346-464c-869a-444f40c3c3ee tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1758 microversion: 2.1 time: 0.398092 Jun 15 19:48:08.031470 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 485/958] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:07 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1758 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:09.047968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:09.048571 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:09.055239 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:09.055679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:09.056427 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:09.056853 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:09.197044 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:09.204961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2d95d90d-ab5e-4151-96a9-71247626a641 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1761 microversion: 2.1 time: 0.160952 Jun 15 19:48:09.205548 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 474/959] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:09 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1761 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:41.616073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1416027551"}} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:48:41.616707 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:41.619776 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=12 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:48:41.620447 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:48:41.626248 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:41.626722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:41.627709 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:41.628413 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:41.771315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.network.security_group_api [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Removing security group 7460d356-0aa1-4382-beeb-f3ea4b777bb5 from port 1d0b45aa-c70d-4006-b056-768daf2e3807 Jun 15 19:48:42.146143 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d3ba3ac6-5358-44bf-bd2d-92e9c5e8758b tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/action" status: 202 len: 0 microversion: 2.1 time: 0.534919 Jun 15 19:48:42.146939 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 486/960] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Jun 15 19:48:41 2022] POST /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:48:42.158107 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=12 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:48:42.159586 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=36 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:48:42.259396 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-933f8089-93e5-4914-a672-4f3dd1a829e8 req-6a51d540-71ac-45a2-bf13-8a955b499555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:48:42.271268 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-933f8089-93e5-4914-a672-4f3dd1a829e8 req-6a51d540-71ac-45a2-bf13-8a955b499555 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:42.272485 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-933f8089-93e5-4914-a672-4f3dd1a829e8 req-6a51d540-71ac-45a2-bf13-8a955b499555 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:42.294725 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-933f8089-93e5-4914-a672-4f3dd1a829e8 req-6a51d540-71ac-45a2-bf13-8a955b499555 service nova] Creating event network-changed:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:48:42.302132 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-933f8089-93e5-4914-a672-4f3dd1a829e8 req-6a51d540-71ac-45a2-bf13-8a955b499555 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148729 Jun 15 19:48:42.304348 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 475/961] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:48:43.387446 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:43.388083 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:43.394567 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:43.395029 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:43.395810 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:43.396243 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:43.489356 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lazy-loading 'services' on Instance uuid aa5a5059-662f-48f0-903e-a615869cd2eb {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:48:43.586577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-9bf5a899-3379-4b2d-99fb-c4825ec85ac7 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments/4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2" status: 202 len: 0 microversion: 2.1 time: 0.202820 Jun 15 19:48:43.587195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 487/962] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:48:43 2022] DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments/4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:48:43.597072 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:43.598138 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:43.609972 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:43.610544 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:43.611329 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:43.611941 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:43.654734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-5cb12890-68ab-48f4-8a3d-3c2b31157946 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061910 Jun 15 19:48:43.655317 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 476/963] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:48:43 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:48:44.320550 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-2ad7dbee-ac2f-4588-802a-9dd5f6575014 req-5b9bb677-3849-4862-9fcc-16ada9c36ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:48:44.330071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-2ad7dbee-ac2f-4588-802a-9dd5f6575014 req-5b9bb677-3849-4862-9fcc-16ada9c36ec6 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:44.330670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-2ad7dbee-ac2f-4588-802a-9dd5f6575014 req-5b9bb677-3849-4862-9fcc-16ada9c36ec6 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:44.351103 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-2ad7dbee-ac2f-4588-802a-9dd5f6575014 req-5b9bb677-3849-4862-9fcc-16ada9c36ec6 service nova] Creating event network-changed:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:48:44.358213 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-2ad7dbee-ac2f-4588-802a-9dd5f6575014 req-5b9bb677-3849-4862-9fcc-16ada9c36ec6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041369 Jun 15 19:48:44.360020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 488/964] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:48:44.670562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:44.672205 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:44.680761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:44.681274 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:44.682213 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:44.683001 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:44.728814 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-feab0f8e-575e-4990-b775-0c563e3a677d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065974 Jun 15 19:48:44.729397 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 477/965] 10.222.0.15 () {58 vars in 1301 bytes} [Wed Jun 15 19:48:44 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 19:48:44.740721 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:44.741605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:44.748271 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:44.748824 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:44.749620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:44.750205 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:44.830839 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] HTTP exception thrown: Instance aa5a5059-662f-48f0-903e-a615869cd2eb is not attached to volume 4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Request method failure captured: Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments/4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 HTTP/1.1 Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjckQPiCsjUTz1C0Rj3RJ48lpt05Sp_NVcJm2Dj1cLkscnltxk5iwmZDNNb5DSy6IkL5wIf6gKyEelaUW1KdEvgAcFp-rpnnzKys5wYoHveV2gca-w4BFZMYS3F0J5rU4xfwcrpBS_YzjMwpKc8l-BV58vLbXathYS6o_OXuxSMvQJQ Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 5eeb6d09ac2a459183dac0e66a26b4bc Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-TestMinimumBasicScenario-1673623414 Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:48:44.833226 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5eeb6d09ac2a459183dac0e66a26b4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5eeb6d09ac2a459183dac0e66a26b4bc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5eeb6d09ac2a459183dac0e66a26b4bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5eeb6d09ac2a459183dac0e66a26b4bc"}]}] Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-TestMinimumBasicScenario-1673623414 Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 5eeb6d09ac2a459183dac0e66a26b4bc Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1673623414 Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-TestMinimumBasicScenario-1673623414-project Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: 841ccfe45fc64b15b97426ee692deb5b Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-TestMinimumBasicScenario-1673623414-project Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:48:44.835117 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance aa5a5059-662f-48f0-903e-a615869cd2eb is not attached to volume 4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'server_id': 'aa5a5059-662f-48f0-903e-a615869cd2eb', 'id': '4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2'} Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2. Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:48:44.836005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5a5059-662f-48f0-903e-a615869cd2eb is not attached to volume 4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5a5059-662f-48f0-903e-a615869cd2eb is not attached to volume 4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:44.837491 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Returning 404 to user: Instance aa5a5059-662f-48f0-903e-a615869cd2eb is not attached to volume 4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:48:44.838944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f426c737-948b-4b0f-b427-c82e82d79720 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments/4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2" status: 404 len: 154 microversion: 2.1 time: 0.099112 Jun 15 19:48:44.838944 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 489/966] 10.222.0.15 () {58 vars in 1415 bytes} [Wed Jun 15 19:48:44 2022] DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb/os-volume_attachments/4fb7c6e2-442c-43d0-9b2a-8d2ebc2d61c2 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:48:45.989611 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:45.990524 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:45.997554 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:45.998003 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:45.998809 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:45.999244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:46.025104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:48:46.124434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-83e40a4d-54ac-4861-a549-7748c32d8f5c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 204 len: 0 microversion: 2.1 time: 0.138441 Jun 15 19:48:46.125083 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 478/967] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:48:45 2022] DELETE /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 19:48:46.136132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:46.136966 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:46.144488 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:46.145406 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:46.145766 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:46.146200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:46.292464 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:46.300291 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f28764b5-c189-4697-99e8-415b10c20ecc tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1555 microversion: 2.1 time: 0.168934 Jun 15 19:48:46.300873 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 490/968] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:46 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:47.318906 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:47.319610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:47.326598 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:47.327066 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:47.327848 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:47.328289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:47.472896 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:47.481218 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2df324b8-9ad1-486c-aa18-231d929de5f6 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1555 microversion: 2.1 time: 0.166604 Jun 15 19:48:47.483932 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 479/969] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:47 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:48.346057 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-d2691082-3e2d-42da-ab2b-08ec3b779a7b req-b6d9ed5b-9b70-462c-8b18-258a5c3fbe55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a5059-662f-48f0-903e-a615869cd2eb", "name": "network-vif-deleted", "tag": "1d0b45aa-c70d-4006-b056-768daf2e3807"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:48:48.355268 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-d2691082-3e2d-42da-ab2b-08ec3b779a7b req-b6d9ed5b-9b70-462c-8b18-258a5c3fbe55 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:48.355716 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-d2691082-3e2d-42da-ab2b-08ec3b779a7b req-b6d9ed5b-9b70-462c-8b18-258a5c3fbe55 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:48.368338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-d2691082-3e2d-42da-ab2b-08ec3b779a7b req-b6d9ed5b-9b70-462c-8b18-258a5c3fbe55 service nova] Creating event network-vif-deleted:1d0b45aa-c70d-4006-b056-768daf2e3807 for instance aa5a5059-662f-48f0-903e-a615869cd2eb on hv-cinder-84456 Jun 15 19:48:48.373365 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-d2691082-3e2d-42da-ab2b-08ec3b779a7b req-b6d9ed5b-9b70-462c-8b18-258a5c3fbe55 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101772 Jun 15 19:48:48.373957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 491/970] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:48:48.501987 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:48.502607 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:48.509635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:48.510081 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:48.510880 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:48.511310 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:48.548156 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:48.548712 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:48.549137 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.objects.instance [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lazy-loading 'fault' on Instance uuid aa5a5059-662f-48f0-903e-a615869cd2eb {{(pid=129334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:48:48.594496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841ccfe45fc64b15b97426ee692deb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6d09ac2a459183dac0e66a26b4bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:48:48.604488 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2b28f88c-3f0e-4e3d-b90e-550cfe391555 tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 200 len: 1348 microversion: 2.1 time: 0.107396 Jun 15 19:48:48.613514 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 480/971] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:48 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:48:49.623485 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:49.624099 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] [instance: aa5a5059-662f-48f0-903e-a615869cd2eb] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:48:49.630457 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:49.630911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:49.631683 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:48:49.632116 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:48:49.647429 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] HTTP exception thrown: Instance aa5a5059-662f-48f0-903e-a615869cd2eb could not be found. Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Request method failure captured: Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb HTTP/1.1 Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjckQPiCsjUTz1C0Rj3RJ48lpt05Sp_NVcJm2Dj1cLkscnltxk5iwmZDNNb5DSy6IkL5wIf6gKyEelaUW1KdEvgAcFp-rpnnzKys5wYoHveV2gca-w4BFZMYS3F0J5rU4xfwcrpBS_YzjMwpKc8l-BV58vLbXathYS6o_OXuxSMvQJQ Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: 5eeb6d09ac2a459183dac0e66a26b4bc Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-TestMinimumBasicScenario-1673623414 Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:48:49.649613 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5eeb6d09ac2a459183dac0e66a26b4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5eeb6d09ac2a459183dac0e66a26b4bc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5eeb6d09ac2a459183dac0e66a26b4bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5eeb6d09ac2a459183dac0e66a26b4bc"}]}] Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-TestMinimumBasicScenario-1673623414 Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: 5eeb6d09ac2a459183dac0e66a26b4bc Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1673623414 Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-TestMinimumBasicScenario-1673623414-project Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: 841ccfe45fc64b15b97426ee692deb5b Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-TestMinimumBasicScenario-1673623414-project Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance aa5a5059-662f-48f0-903e-a615869cd2eb could not be found. Jun 15 19:48:49.651342 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': 'aa5a5059-662f-48f0-903e-a615869cd2eb'} Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5a5059-662f-48f0-903e-a615869cd2eb could not be found. Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:48:49.652180 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5a5059-662f-48f0-903e-a615869cd2eb could not be found. Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5a5059-662f-48f0-903e-a615869cd2eb could not be found. Jun 15 19:48:49.653992 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:48:49.655445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Returning 404 to user: Instance aa5a5059-662f-48f0-903e-a615869cd2eb could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:48:49.655445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b4d90c57-43bb-442d-94e0-560085fb1f5d tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb" status: 404 len: 111 microversion: 2.1 time: 0.032408 Jun 15 19:48:49.655445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 492/972] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:48:49 2022] GET /compute/v2.1/servers/aa5a5059-662f-48f0-903e-a615869cd2eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:48:49.660649 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-48a170fb-74f2-40d3-85e2-a14d3206677c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] Calling method '.version_select at 0x7f16457230d0>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:48:49.678817 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-48a170fb-74f2-40d3-85e2-a14d3206677c tempest-TestMinimumBasicScenario-1673623414 tempest-TestMinimumBasicScenario-1673623414-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-261403087" status: 202 len: 0 microversion: 2.1 time: 0.021860 Jun 15 19:48:49.679380 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 481/973] 10.222.0.15 () {58 vars in 1268 bytes} [Wed Jun 15 19:48:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-261403087 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:49:05.919685 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:05.920435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:05.924437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-57b83d65-cebe-4cb4-9f9f-4b96f90ac2bc req-aa6c9c06-a96b-4d0e-917c-c75312f0648c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:05.928649 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:05.929133 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:05.931994 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=14 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:05.932753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:05.939042 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:05.939710 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:05.940312 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-57b83d65-cebe-4cb4-9f9f-4b96f90ac2bc req-aa6c9c06-a96b-4d0e-917c-c75312f0648c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:05.940764 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-57b83d65-cebe-4cb4-9f9f-4b96f90ac2bc req-aa6c9c06-a96b-4d0e-917c-c75312f0648c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:05.940912 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:05.941268 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:05.954127 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-57b83d65-cebe-4cb4-9f9f-4b96f90ac2bc req-aa6c9c06-a96b-4d0e-917c-c75312f0648c service nova] Creating event network-changed:98860632-f1d4-48e3-a840-1307deb28658 for instance c00cb912-861b-45f1-a2e8-7efe52291be6 on hv-cinder-84456 Jun 15 19:49:05.959690 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-57b83d65-cebe-4cb4-9f9f-4b96f90ac2bc req-aa6c9c06-a96b-4d0e-917c-c75312f0648c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041585 Jun 15 19:49:05.960291 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 482/974] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:49:05.968762 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:49:06.054803 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-699fd1d8-ec62-4357-b71d-2771bef57ecf tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 204 len: 0 microversion: 2.1 time: 0.141929 Jun 15 19:49:06.056005 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 493/975] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:49:05 2022] DELETE /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:49:06.064917 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:06.065626 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:06.072041 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:06.072496 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:06.073280 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:06.073719 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:06.225569 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:06.234501 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1922ec16-6c71-4066-b5e0-0013419c156d tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.173712 Jun 15 19:49:06.235304 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 483/976] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:06 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:07.252993 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:07.253696 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:07.260459 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:07.260906 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:07.261677 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:07.262128 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:07.408746 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:07.417670 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-7fe3b9e4-3085-4ac2-bd06-be70d1bd6371 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1568 microversion: 2.1 time: 0.168859 Jun 15 19:49:07.418273 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 494/977] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:07 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:08.011970 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-d92a2bfc-c811-4d88-9061-3dd2c97d331a req-cfd739f0-537c-4a77-9ff3-abaa3a9943e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00cb912-861b-45f1-a2e8-7efe52291be6", "name": "network-vif-deleted", "tag": "98860632-f1d4-48e3-a840-1307deb28658"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:08.021961 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d92a2bfc-c811-4d88-9061-3dd2c97d331a req-cfd739f0-537c-4a77-9ff3-abaa3a9943e4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:08.022441 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d92a2bfc-c811-4d88-9061-3dd2c97d331a req-cfd739f0-537c-4a77-9ff3-abaa3a9943e4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:08.035672 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-d92a2bfc-c811-4d88-9061-3dd2c97d331a req-cfd739f0-537c-4a77-9ff3-abaa3a9943e4 service nova] Creating event network-vif-deleted:98860632-f1d4-48e3-a840-1307deb28658 for instance c00cb912-861b-45f1-a2e8-7efe52291be6 on hv-cinder-84456 Jun 15 19:49:08.040708 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-d92a2bfc-c811-4d88-9061-3dd2c97d331a req-cfd739f0-537c-4a77-9ff3-abaa3a9943e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Jun 15 19:49:08.041467 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 484/978] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:49:08.435996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:08.436616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:08.443813 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:08.444254 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:08.445131 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:08.445574 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:08.480121 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:08.480577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:08.481138 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lazy-loading 'fault' on Instance uuid c00cb912-861b-45f1-a2e8-7efe52291be6 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:49:08.525620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ca9a3e7826b4928863bd83a9496205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feaa96a8901e42c18c270c092a40fc83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:08.533641 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-834376c2-a2fc-422f-a416-2c2d5e83c974 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 200 len: 1224 microversion: 2.1 time: 0.101500 Jun 15 19:49:08.534172 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 495/979] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:08 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:09.551704 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:09.552406 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] [instance: c00cb912-861b-45f1-a2e8-7efe52291be6] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:09.559797 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:09.560244 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:09.561014 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:09.561450 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:09.574795 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] HTTP exception thrown: Instance c00cb912-861b-45f1-a2e8-7efe52291be6 could not be found. Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Request method failure captured: Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 HTTP/1.1 Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjaOf3WCOJsC4DpQF0Uokz5zhr5Euw55qsURkRV1EzgzOPCgiFNnDob56QUZva2R4PaYYfloqVaq-OvznuAyvegtYuW-E_fZWKbNaK5smKd81eksZAoy69XfI2EzRZDUx2lcOMYB1hVBQsu7uzYAfNwH-uZYts9zbCOn_IhKVFILn5c Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: feaa96a8901e42c18c270c092a40fc83 Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-TestShelveInstance-258480061 Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:49:09.576414 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/feaa96a8901e42c18c270c092a40fc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_feaa96a8901e42c18c270c092a40fc83", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/feaa96a8901e42c18c270c092a40fc83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/feaa96a8901e42c18c270c092a40fc83"}]}] Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-TestShelveInstance-258480061 Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: feaa96a8901e42c18c270c092a40fc83 Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-TestShelveInstance-258480061 Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-TestShelveInstance-258480061-project Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: 4ca9a3e7826b4928863bd83a9496205a Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-TestShelveInstance-258480061-project Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance c00cb912-861b-45f1-a2e8-7efe52291be6 could not be found. Jun 15 19:49:09.578230 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'c00cb912-861b-45f1-a2e8-7efe52291be6'} Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00cb912-861b-45f1-a2e8-7efe52291be6 could not be found. Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:49:09.579233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00cb912-861b-45f1-a2e8-7efe52291be6 could not be found. Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00cb912-861b-45f1-a2e8-7efe52291be6 could not be found. Jun 15 19:49:09.580911 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:49:09.582556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Returning 404 to user: Instance c00cb912-861b-45f1-a2e8-7efe52291be6 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:49:09.582556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-59630caf-2f93-47d6-91bb-8f1c56969884 tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6" status: 404 len: 111 microversion: 2.1 time: 0.030343 Jun 15 19:49:09.582556 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 485/980] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:09 2022] GET /compute/v2.1/servers/c00cb912-861b-45f1-a2e8-7efe52291be6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:49:09.746335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-271b91f3-7b9e-43c7-b136-669c025d563e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] Calling method '.version_select at 0x7f16457e2820>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:09.765599 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-271b91f3-7b9e-43c7-b136-669c025d563e tempest-TestShelveInstance-258480061 tempest-TestShelveInstance-258480061-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-146664860" status: 202 len: 0 microversion: 2.1 time: 0.023175 Jun 15 19:49:09.766288 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 496/981] 10.222.0.15 () {58 vars in 1250 bytes} [Wed Jun 15 19:49:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-146664860 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:49:29.396991 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:29.397591 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:29.400506 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=8 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:29.401124 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=12 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:29.407089 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:29.407531 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:29.408292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:29.408725 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:29.435161 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Going to try to terminate instance {{(pid=129334) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:49:29.515472 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a44708ff-deac-4f7f-81bc-beab2f3793ee tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "DELETE /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 204 len: 0 microversion: 2.1 time: 0.122016 Jun 15 19:49:29.516268 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 486/982] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:49:29 2022] DELETE /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:49:29.522051 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:29.523034 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:29.528055 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:29.528647 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:29.537960 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:29.538441 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:29.539229 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:29.539700 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:29.679188 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:29.686933 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-aaf26a0f-c302-4a0a-81e4-64649f729ad4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1576 microversion: 2.1 time: 0.166571 Jun 15 19:49:29.687498 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 497/983] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:29 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:30.705372 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:30.705976 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:30.712456 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:30.712898 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:30.713653 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:30.714113 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:30.847225 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:30.854944 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-861b700b-5471-47b7-a7cf-1c8a542e4c9f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1576 microversion: 2.1 time: 0.153767 Jun 15 19:49:30.855515 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 487/984] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:30 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:31.828033 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-2645e328-594d-4204-a134-3be393a598ae req-db192084-b1d5-48a6-9a53-50de992b51b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c741e5-dd61-47bd-9d45-7a33d5f0eb6c", "name": "network-vif-deleted", "tag": "0a4b2324-33cc-4785-a82e-68b01b7613ed"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:31.843273 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-2645e328-594d-4204-a134-3be393a598ae req-db192084-b1d5-48a6-9a53-50de992b51b8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:31.843828 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-2645e328-594d-4204-a134-3be393a598ae req-db192084-b1d5-48a6-9a53-50de992b51b8 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:31.855911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-2645e328-594d-4204-a134-3be393a598ae req-db192084-b1d5-48a6-9a53-50de992b51b8 service nova] Creating event network-vif-deleted:0a4b2324-33cc-4785-a82e-68b01b7613ed for instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c on hv-cinder-84456 Jun 15 19:49:31.861722 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-2645e328-594d-4204-a134-3be393a598ae req-db192084-b1d5-48a6-9a53-50de992b51b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037308 Jun 15 19:49:31.862741 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 498/985] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:49:31.872799 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:31.873691 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:31.880443 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:31.881216 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:31.882940 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:31.884126 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:31.969166 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:31.977229 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-71cd6ba9-4061-49b8-bfe8-47c5dfc6829d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 200 len: 1225 microversion: 2.1 time: 0.108855 Jun 15 19:49:31.978179 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 488/986] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:31 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:32.997775 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:32.998747 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:33.005458 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:33.005911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:33.006765 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:33.007199 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:33.025762 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] HTTP exception thrown: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Request method failure captured: Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c HTTP/1.1 Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjcbwnwwemReTstZhDMJYRD1CsFrHwit4pGibHY9f4w9e-9BuqriA2wwvULWduUQHd1wGJM4kulhzHlNU3aN_xXkfqIyMvPpZMEPxYiynfJXgFKuMcchLZ9a4PrzEHl50Wrfb4edNCxRbm6m2QepCXJ0-y_yHUvBGyakHNUS31woKGE Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:49:33.027471 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b7cdb8d3ddc84d0fbd6128c3b46d05f7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}] Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f3eb282e55c941ef9fefb57e14a708f1 Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:49:33.029208 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '72c741e5-dd61-47bd-9d45-7a33d5f0eb6c'} Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:49:33.030758 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:49:33.032538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:49:33.034225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Returning 404 to user: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:49:33.034225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-29044332-6f35-45f2-aced-90d3f38a1a27 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 404 len: 111 microversion: 2.1 time: 0.036068 Jun 15 19:49:33.034225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 499/987] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:32 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:49:33.178437 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1358507817", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1701459937", "security_groups": [{"name": "tempest-secgroup-smoke-107218427"}], "block_device_mapping_v2": [{"uuid": "5b492081-be25-4322-a990-7092933b6a3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "027be43c-318b-4ede-b89b-bf032d141bce"}]}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:33.295135 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] validate_networks() for [('027be43c-318b-4ede-b89b-bf032d141bce', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:49:33.680022 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:49:33.680435 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:49:33.680912 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:49:33.681319 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:49:33.681722 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:49:33.690568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:33.691012 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:33.691815 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:33.692252 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:33.709571 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:49:33.713706 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for user f3eb282e55c941ef9fefb57e14a708f1 and project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:49:33.777630 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:49:33.779756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5b492081-be25-4322-a990-7092933b6a3c',volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:49:33.910532 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [bd25f8da-bbbb-4f84-a5e1-1807870c08b9] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 19:49:34.918107 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [bd25f8da-bbbb-4f84-a5e1-1807870c08b9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 39576. Jun 15 19:49:34.923789 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2ef0f725-807b-4619-8162-74f1f31bc111 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.748941 Jun 15 19:49:34.930153 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 489/988] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:49:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:49:34.935564 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-c265658d-cb79-4490-ac15-2473d2ea4174 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:34.936245 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-c265658d-cb79-4490-ac15-2473d2ea4174 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:34.991848 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-c265658d-cb79-4490-ac15-2473d2ea4174 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:34.999704 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-c265658d-cb79-4490-ac15-2473d2ea4174 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1095 microversion: 2.1 time: 0.067998 Jun 15 19:49:35.000270 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 500/989] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:34 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:36.017631 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-71996d37-4241-420d-aa1e-112514c6942f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:36.018267 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-71996d37-4241-420d-aa1e-112514c6942f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:36.082745 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-71996d37-4241-420d-aa1e-112514c6942f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:36.091872 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-71996d37-4241-420d-aa1e-112514c6942f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1095 microversion: 2.1 time: 0.078443 Jun 15 19:49:36.092455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 490/990] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:36 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:49:37.108833 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-863cacb7-aabf-4e64-bf67-677f06f2bc4d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:37.109435 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-863cacb7-aabf-4e64-bf67-677f06f2bc4d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:37.164068 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-863cacb7-aabf-4e64-bf67-677f06f2bc4d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:37.171306 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-863cacb7-aabf-4e64-bf67-677f06f2bc4d tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1095 microversion: 2.1 time: 0.066329 Jun 15 19:49:37.172111 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 501/991] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:37 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:38.188102 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ff13183c-dfcf-495c-b711-f8021c730bc0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:38.188717 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ff13183c-dfcf-495c-b711-f8021c730bc0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:38.245471 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ff13183c-dfcf-495c-b711-f8021c730bc0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:38.252480 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ff13183c-dfcf-495c-b711-f8021c730bc0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1095 microversion: 2.1 time: 0.068272 Jun 15 19:49:38.253076 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 491/992] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:38 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:39.272334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:39.273589 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:39.283061 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:39.283745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:39.284525 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:39.284957 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:39.346770 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:39.354349 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-d2b9cd8e-5ccc-4123-85ac-87df253e1a25 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1145 microversion: 2.1 time: 0.087945 Jun 15 19:49:39.354915 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 502/993] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:39 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:40.371340 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:40.371953 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:40.378957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:40.379403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:40.380173 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:40.380853 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:40.457914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:40.467358 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1ad98de7-7749-4b08-a6d6-1213e7a2b916 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1211 microversion: 2.1 time: 0.100598 Jun 15 19:49:40.477172 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 492/994] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:40 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:41.488095 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:41.489195 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:41.493261 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-96e37077-1a67-4095-9382-d24eaae07ec8 req-e71066f0-e578-444b-a3a5-d527b7058cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b491aa-2d8a-42ac-8399-3636cd440b12", "tag": "4fcb17c7-57eb-4093-bf16-612242dcaec4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:41.514829 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:41.515536 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:41.518243 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:41.519233 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:41.529604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-96e37077-1a67-4095-9382-d24eaae07ec8 req-e71066f0-e578-444b-a3a5-d527b7058cff service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:41.530405 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-96e37077-1a67-4095-9382-d24eaae07ec8 req-e71066f0-e578-444b-a3a5-d527b7058cff service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:41.564734 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-96e37077-1a67-4095-9382-d24eaae07ec8 req-e71066f0-e578-444b-a3a5-d527b7058cff service nova] Creating event network-changed:4fcb17c7-57eb-4093-bf16-612242dcaec4 for instance a9b491aa-2d8a-42ac-8399-3636cd440b12 on hv-cinder-84456 Jun 15 19:49:41.576130 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-96e37077-1a67-4095-9382-d24eaae07ec8 req-e71066f0-e578-444b-a3a5-d527b7058cff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103140 Jun 15 19:49:41.577949 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 503/995] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:49:41.708321 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:41.716403 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-10f89244-4e56-43f1-a5be-e3fc55301470 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.234902 Jun 15 19:49:41.716992 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 493/996] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:41 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:42.735080 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:42.735781 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:42.743132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:42.743578 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:42.744358 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:42.744797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:42.880663 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:42.891127 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f030f79d-6d56-4d44-a222-d8e57b942dce tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.160258 Jun 15 19:49:42.891734 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 504/997] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:42 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:43.908069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:43.908686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:43.912382 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:43.917490 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:43.917968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:43.918778 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:43.919219 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:44.058105 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:44.065914 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-1c071b12-d4b6-4a52-823f-2e9d7c0a396a tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.161715 Jun 15 19:49:44.066520 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 494/998] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:43 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:45.083520 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:45.084123 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:45.091469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:45.091925 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:45.095279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:45.095279 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:45.232666 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:45.240799 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-537d4bcf-143f-431b-8254-fdd2483b6a2c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.161122 Jun 15 19:49:45.241679 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 505/999] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:45 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:46.257644 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:46.258268 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:46.264984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:46.265424 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:46.266208 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:46.266637 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:46.405591 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:46.413600 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-0df03b8e-dd5f-4cb4-9a69-a1411887e8d5 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.160190 Jun 15 19:49:46.414208 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 495/1000] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:46 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:47.432999 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:47.433714 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:47.436237 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=4 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:47.441779 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:47.442259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:47.443038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:47.443473 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:47.582132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:47.592726 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1d7f7c56-84af-4514-9191-f2305f26ed98 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.165937 Jun 15 19:49:47.593344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 506/1001] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:47 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:48.610069 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:48.610651 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:48.612892 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=10 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:49:48.619089 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:48.619539 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:48.620306 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:48.620729 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:48.754272 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:48.762048 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-a3f36960-b6ed-4a1e-afed-faa2d10722e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.156030 Jun 15 19:49:48.762647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 496/1002] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:48 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:49.782761 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:49.783372 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:49.790224 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:49.790681 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:49.791466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:49.791906 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:49.928604 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:49.936338 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-75f34f19-6286-4996-bdd9-af95ce6875be tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.159761 Jun 15 19:49:49.936917 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 507/1003] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:49 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:50.953836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:50.954513 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:50.961301 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:50.961742 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:50.962553 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:50.962981 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:51.097857 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:51.105773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-52426395-fb40-4317-9bda-a59d534cda40 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.155891 Jun 15 19:49:51.106386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 497/1004] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:50 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:52.123200 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:52.123849 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:52.130969 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:52.131495 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:52.132862 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:52.133335 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:52.271431 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:52.279878 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-814c2492-f475-433b-bc1c-9b2dec3e423c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.160878 Jun 15 19:49:52.280445 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 508/1005] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:52 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:53.296616 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:53.297300 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:53.304821 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:53.305838 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:53.306876 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:53.307378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:53.416102 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-d885b873-3fda-49a6-a76f-fec1a179a28c req-026419c5-349e-4f5d-b4c7-ebd8de36db2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b491aa-2d8a-42ac-8399-3636cd440b12", "name": "network-vif-plugged", "status": "completed", "tag": "4fcb17c7-57eb-4093-bf16-612242dcaec4"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:53.424448 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d885b873-3fda-49a6-a76f-fec1a179a28c req-026419c5-349e-4f5d-b4c7-ebd8de36db2b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:53.424928 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-d885b873-3fda-49a6-a76f-fec1a179a28c req-026419c5-349e-4f5d-b4c7-ebd8de36db2b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:53.436175 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-d885b873-3fda-49a6-a76f-fec1a179a28c req-026419c5-349e-4f5d-b4c7-ebd8de36db2b service nova] Creating event network-vif-plugged:4fcb17c7-57eb-4093-bf16-612242dcaec4 for instance a9b491aa-2d8a-42ac-8399-3636cd440b12 on hv-cinder-84456 Jun 15 19:49:53.441222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-d885b873-3fda-49a6-a76f-fec1a179a28c req-026419c5-349e-4f5d-b4c7-ebd8de36db2b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181304 Jun 15 19:49:53.441810 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 498/1006] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:49:53.452031 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:53.459654 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-b0f93964-3001-43fe-99be-03fca1adcec9 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.166908 Jun 15 19:49:53.460327 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 509/1007] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:53 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:54.478720 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:54.479415 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:54.485827 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:54.486308 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:54.487076 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:54.487510 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:54.625261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:54.638768 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ec43a023-262b-4903-99f4-7969b4c0ce8c tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1266 microversion: 2.1 time: 0.165213 Jun 15 19:49:54.639734 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 499/1008] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:54 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:55.658132 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:55.658698 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:55.666047 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:55.666529 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:55.667315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:55.667760 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:55.808767 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:55.816469 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-cb5bbfb8-f38b-4e6f-9d42-204d5f02b8dd tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1454 microversion: 2.1 time: 0.162325 Jun 15 19:49:55.817043 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 510/1009] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:55 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:55.833077 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:49:55.833856 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:49:55.841182 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:55.841620 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:55.842418 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:55.842849 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:55.976387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:49:55.984181 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7bd45a23-323d-4661-a908-8e6ac6ef3b26 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1454 microversion: 2.1 time: 0.154889 Jun 15 19:49:55.984741 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 500/1010] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:49:55 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:49:57.888793 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-1380c387-7a54-4634-bbb4-9bcf068f3a96 req-47bec0df-e634-4433-bae2-5ba205602974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b491aa-2d8a-42ac-8399-3636cd440b12", "tag": "4fcb17c7-57eb-4093-bf16-612242dcaec4"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:49:57.897832 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1380c387-7a54-4634-bbb4-9bcf068f3a96 req-47bec0df-e634-4433-bae2-5ba205602974 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:49:57.898315 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-1380c387-7a54-4634-bbb4-9bcf068f3a96 req-47bec0df-e634-4433-bae2-5ba205602974 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:49:57.909923 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-1380c387-7a54-4634-bbb4-9bcf068f3a96 req-47bec0df-e634-4433-bae2-5ba205602974 service nova] Creating event network-changed:4fcb17c7-57eb-4093-bf16-612242dcaec4 for instance a9b491aa-2d8a-42ac-8399-3636cd440b12 on hv-cinder-84456 Jun 15 19:49:57.915911 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-1380c387-7a54-4634-bbb4-9bcf068f3a96 req-47bec0df-e634-4433-bae2-5ba205602974 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030803 Jun 15 19:49:57.916525 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 511/1011] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:51:16.990901 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:51:16.991537 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:51:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:51:32.034736 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:32.035481 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:32.039744 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-412074936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1701459937", "security_groups": [{"name": "tempest-secgroup-smoke-107218427"}], "block_device_mapping_v2": [{"uuid": "0b7f8b97-e94c-4bdd-85d0-f445c0668c92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "027be43c-318b-4ede-b89b-bf032d141bce"}]}} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:51:32.152334 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.network.neutron [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] validate_networks() for [('027be43c-318b-4ede-b89b-bf032d141bce', None, None, None, None, None)] {{(pid=129334) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 19:51:32.737688 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Flavor limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 19:51:32.738134 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Image limits 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 19:51:32.738610 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Flavor pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 19:51:32.739016 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Image pref 0:0:0 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 19:51:32.739423 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.virt.hardware [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 19:51:32.749131 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:32.749579 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:32.750405 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:32.750841 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:32.767386 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 19:51:32.771335 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.quota [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Getting quotas for user f3eb282e55c941ef9fefb57e14a708f1 and project b7cdb8d3ddc84d0fbd6128c3b46d05f7. Resources: {'ram', 'cores', 'instances'} {{(pid=129334) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 19:51:32.826901 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Going to run 1 instances... {{(pid=129334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 19:51:32.828957 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b7f8b97-e94c-4bdd-85d0-f445c0668c92',volume_size=None,volume_type=None)] {{(pid=129334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 19:51:32.952800 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-ca607aee-d8ad-4bc5-9a29-c18b594bd063 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.919720 Jun 15 19:51:32.953429 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 501/1012] 10.222.0.15 () {60 vars in 1146 bytes} [Wed Jun 15 19:51:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 19:51:32.962538 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=34 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:32.963363 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=62 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:32.968332 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e5e0cfbd-bfb4-4da4-8d89-1d697dd27c0f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:32.969038 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e5e0cfbd-bfb4-4da4-8d89-1d697dd27c0f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:33.028157 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e5e0cfbd-bfb4-4da4-8d89-1d697dd27c0f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:33.034867 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e5e0cfbd-bfb4-4da4-8d89-1d697dd27c0f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1094 microversion: 2.1 time: 0.074523 Jun 15 19:51:33.035425 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 512/1013] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:32 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:34.053104 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:34.054942 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:34.062275 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:34.062821 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:34.063863 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:34.064421 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:34.129121 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:34.136808 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7fee059b-4933-4a5f-b13d-ba447cfc2622 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1192 microversion: 2.1 time: 0.088351 Jun 15 19:51:34.137381 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 502/1014] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:34 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:35.155426 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:35.155983 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:35.165829 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:35.166956 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:35.168227 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:35.168964 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:35.304920 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:35.312514 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e007f277-d322-421d-85b8-6b9db00f7541 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.161391 Jun 15 19:51:35.313093 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 513/1015] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:35 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:51:35.600426 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-12a79e37-ddc5-457f-8087-52fde89a26ff req-e4c7e72f-f288-436e-b915-267650bb4f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209b2f19-cdd1-4162-b5f5-429775658986", "tag": "b705b8fb-a424-43b8-a6ea-4f13065ff31d"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:51:35.609320 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-12a79e37-ddc5-457f-8087-52fde89a26ff req-e4c7e72f-f288-436e-b915-267650bb4f4c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:35.610236 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-12a79e37-ddc5-457f-8087-52fde89a26ff req-e4c7e72f-f288-436e-b915-267650bb4f4c service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:35.633125 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-12a79e37-ddc5-457f-8087-52fde89a26ff req-e4c7e72f-f288-436e-b915-267650bb4f4c service nova] Creating event network-changed:b705b8fb-a424-43b8-a6ea-4f13065ff31d for instance 209b2f19-cdd1-4162-b5f5-429775658986 on hv-cinder-84456 Jun 15 19:51:35.638773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-12a79e37-ddc5-457f-8087-52fde89a26ff req-e4c7e72f-f288-436e-b915-267650bb4f4c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042368 Jun 15 19:51:35.639761 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 503/1016] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:51:36.140023 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:51:36.140309 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Wed Jun 15 19:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:51:36.330421 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:36.331102 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:36.340540 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:36.341087 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:36.341981 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:36.342657 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:36.507961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:36.519797 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-bb2ed550-a87b-4524-bd56-497c7a6ca0f6 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.193568 Jun 15 19:51:36.520813 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 514/1017] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:36 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:37.543966 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:37.544686 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:37.551024 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:37.551463 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:37.552227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:37.552656 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:37.686039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:37.693891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d171a48c-32cd-45fb-9d82-5fd22855a9e0 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.154500 Jun 15 19:51:37.694562 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 504/1018] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:37 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:38.711594 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:38.712160 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:38.718934 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:38.719381 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:38.720146 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:38.720576 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:38.866209 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:38.874347 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-327b6145-6a81-4565-99c1-34aca2ad3baf tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.167126 Jun 15 19:51:38.875222 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 515/1019] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:38 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:39.892748 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:39.893352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:39.900455 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:39.900895 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:39.901647 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:39.902080 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:40.033039 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:40.043749 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7838a38d-0a2e-4d29-bf3a-7bdd89848508 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.154423 Jun 15 19:51:40.044821 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 505/1020] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:39 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:41.063753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:41.064390 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:41.071509 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:41.071953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:41.072732 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:41.073176 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:41.208075 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:41.216195 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-03002046-8175-4dcd-af8c-e5a2c52b2749 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.157161 Jun 15 19:51:41.216757 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 516/1021] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:41 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:42.232836 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:42.233426 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:42.239974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:42.240963 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:42.241727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:42.242322 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:42.380665 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:42.388729 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-b6dc1497-13ca-4476-ba56-dfdf7eb33b4e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.159762 Jun 15 19:51:42.389296 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 506/1022] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:42 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:43.404961 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:43.405554 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:43.407642 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell0:SELECT=2 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:43.413506 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:43.413953 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:43.414746 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:43.415178 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:43.544902 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:43.552583 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-5beb90bf-e412-45ba-b98a-2a147731a296 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.151482 Jun 15 19:51:43.553733 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 517/1023] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:43 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:44.571289 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=2 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:44.572056 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell0:SELECT=6 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:51:44.641694 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:44.642355 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:44.648401 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:44.648849 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:44.649614 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:44.650052 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:44.785530 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:44.793695 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-2d4d3a4e-3186-4c83-85ba-23330f8167a3 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.227547 Jun 15 19:51:44.794292 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 507/1024] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:44 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:45.744745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [req-7fe238e3-da54-40d6-a959-2113c2dadab3 req-1658f5bb-3376-428e-b6f9-e30254f3eea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209b2f19-cdd1-4162-b5f5-429775658986", "name": "network-vif-plugged", "status": "completed", "tag": "b705b8fb-a424-43b8-a6ea-4f13065ff31d"}]} {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:51:45.753548 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-7fe238e3-da54-40d6-a959-2113c2dadab3 req-1658f5bb-3376-428e-b6f9-e30254f3eea4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:45.754620 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [req-7fe238e3-da54-40d6-a959-2113c2dadab3 req-1658f5bb-3376-428e-b6f9-e30254f3eea4 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:45.767154 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.compute.server_external_events [req-7fe238e3-da54-40d6-a959-2113c2dadab3 req-1658f5bb-3376-428e-b6f9-e30254f3eea4 service nova] Creating event network-vif-plugged:b705b8fb-a424-43b8-a6ea-4f13065ff31d for instance 209b2f19-cdd1-4162-b5f5-429775658986 on hv-cinder-84456 Jun 15 19:51:45.772972 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [req-7fe238e3-da54-40d6-a959-2113c2dadab3 req-1658f5bb-3376-428e-b6f9-e30254f3eea4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Jun 15 19:51:45.773562 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 518/1025] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:51:45.819838 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:45.820434 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:45.827454 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:45.827891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:45.828652 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:45.829080 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:45.970568 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:45.978344 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-7bdb1d57-4b0a-4271-83af-9d23154e9084 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.162945 Jun 15 19:51:45.978926 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 508/1026] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:45 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:46.997092 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:46.997794 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:47.004021 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:47.004466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:47.005225 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:47.005658 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:47.141836 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:47.150523 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-0a06d95a-afc9-4310-b6cb-d4a5b66203b4 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1265 microversion: 2.1 time: 0.158515 Jun 15 19:51:47.151089 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 519/1027] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:46 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:48.167618 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:48.168143 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:48.174756 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:48.175209 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:48.175974 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:48.176449 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:48.306767 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:48.314173 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-d6162c8c-1bed-44c7-94ea-3184e2b539ca tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1452 microversion: 2.1 time: 0.150588 Jun 15 19:51:48.314727 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 509/1028] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:48 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:48.331262 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:51:48.331881 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:51:48.338772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:48.339220 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:48.340001 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:48.340443 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:48.470959 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:51:48.478522 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f64b2c8e-816b-4d68-a0e1-bd5295160f4f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1452 microversion: 2.1 time: 0.151066 Jun 15 19:51:48.479076 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 520/1029] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:51:48 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:51:50.019635 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-822a053a-d248-43fa-92c4-8eed313951bf req-014501d5-4e12-4928-8c72-b32cb4ee6dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209b2f19-cdd1-4162-b5f5-429775658986", "tag": "b705b8fb-a424-43b8-a6ea-4f13065ff31d"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:51:50.028677 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-822a053a-d248-43fa-92c4-8eed313951bf req-014501d5-4e12-4928-8c72-b32cb4ee6dee service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:51:50.029122 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-822a053a-d248-43fa-92c4-8eed313951bf req-014501d5-4e12-4928-8c72-b32cb4ee6dee service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:51:50.040695 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-822a053a-d248-43fa-92c4-8eed313951bf req-014501d5-4e12-4928-8c72-b32cb4ee6dee service nova] Creating event network-changed:b705b8fb-a424-43b8-a6ea-4f13065ff31d for instance 209b2f19-cdd1-4162-b5f5-429775658986 on hv-cinder-84456 Jun 15 19:51:50.045939 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-822a053a-d248-43fa-92c4-8eed313951bf req-014501d5-4e12-4928-8c72-b32cb4ee6dee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029939 Jun 15 19:51:50.046641 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 510/1030] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:52:47.759719 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:52:47.760375 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Wed Jun 15 19:52:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:53:30.092180 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:53:30.094386 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:30.094895 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG dbcounter [-] [129334] Writing DB stats nova_cell1:SELECT=48 {{(pid=129334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:53:30.094996 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:30.099753 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_api:SELECT=20 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:53:30.100900 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG dbcounter [-] [129333] Writing DB stats nova_cell1:SELECT=44 {{(pid=129333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 19:53:30.102960 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-3a72e25a-fcf6-40bb-845c-9046c04aa774 req-2655bb15-38ca-4639-be94-c249e7e1803b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209b2f19-cdd1-4162-b5f5-429775658986", "tag": "b705b8fb-a424-43b8-a6ea-4f13065ff31d"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:53:30.112306 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:30.113033 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:30.114695 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:30.115808 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:30.119599 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-3a72e25a-fcf6-40bb-845c-9046c04aa774 req-2655bb15-38ca-4639-be94-c249e7e1803b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:30.120518 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-3a72e25a-fcf6-40bb-845c-9046c04aa774 req-2655bb15-38ca-4639-be94-c249e7e1803b service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:30.134601 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-3a72e25a-fcf6-40bb-845c-9046c04aa774 req-2655bb15-38ca-4639-be94-c249e7e1803b service nova] Creating event network-changed:b705b8fb-a424-43b8-a6ea-4f13065ff31d for instance 209b2f19-cdd1-4162-b5f5-429775658986 on hv-cinder-84456 Jun 15 19:53:30.140769 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-3a72e25a-fcf6-40bb-845c-9046c04aa774 req-2655bb15-38ca-4639-be94-c249e7e1803b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051884 Jun 15 19:53:30.141716 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 511/1031] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:53:30.150962 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:53:30.246987 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-e9d57b04-64dc-43bc-a67c-b21cf60295f2 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "DELETE /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 204 len: 0 microversion: 2.1 time: 0.160205 Jun 15 19:53:30.248156 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 521/1032] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:53:30 2022] DELETE /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:53:30.259071 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:30.260536 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:30.267780 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:30.268448 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:30.269227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:30.269683 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:30.569909 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:53:30.577929 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-598ef3f6-f2be-42d4-9e2e-326b57bc3564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1577 microversion: 2.1 time: 0.324467 Jun 15 19:53:30.578534 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 512/1033] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:30 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1577 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:53:31.596806 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:31.597504 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:31.604399 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:31.604852 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:31.605643 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:31.606071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:31.801334 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:53:31.809855 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-65a71866-a0b5-4f5c-b4bb-93b49f581d62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1577 microversion: 2.1 time: 0.217329 Jun 15 19:53:31.810482 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 522/1034] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:31 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1577 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:53:32.300430 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-981a01eb-f763-453f-854d-f648a9c79ce5 req-b3a566f0-0f54-4b74-9913-a622a8f9c6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209b2f19-cdd1-4162-b5f5-429775658986", "name": "network-vif-deleted", "tag": "b705b8fb-a424-43b8-a6ea-4f13065ff31d"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:53:32.310046 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-981a01eb-f763-453f-854d-f648a9c79ce5 req-b3a566f0-0f54-4b74-9913-a622a8f9c6aa service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:32.310526 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-981a01eb-f763-453f-854d-f648a9c79ce5 req-b3a566f0-0f54-4b74-9913-a622a8f9c6aa service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:32.324387 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-981a01eb-f763-453f-854d-f648a9c79ce5 req-b3a566f0-0f54-4b74-9913-a622a8f9c6aa service nova] Creating event network-vif-deleted:b705b8fb-a424-43b8-a6ea-4f13065ff31d for instance 209b2f19-cdd1-4162-b5f5-429775658986 on hv-cinder-84456 Jun 15 19:53:32.331407 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-981a01eb-f763-453f-854d-f648a9c79ce5 req-b3a566f0-0f54-4b74-9913-a622a8f9c6aa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035072 Jun 15 19:53:32.332722 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 513/1035] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:53:32.830284 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:32.830868 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:32.837737 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:32.838230 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:32.839006 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:32.839459 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:32.873427 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:32.873872 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:32.874344 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lazy-loading 'fault' on Instance uuid 209b2f19-cdd1-4162-b5f5-429775658986 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:53:32.922466 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:53:32.935119 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-6e5def66-d7d0-47e9-ac28-8514a7479245 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 200 len: 1230 microversion: 2.1 time: 0.108570 Jun 15 19:53:32.936078 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 523/1036] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:32 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:53:33.953330 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:33.954049 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 209b2f19-cdd1-4162-b5f5-429775658986] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:33.960998 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:33.961468 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:33.962261 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:33.962692 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:33.976383 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] HTTP exception thrown: Instance 209b2f19-cdd1-4162-b5f5-429775658986 could not be found. Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Request method failure captured: Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 HTTP/1.1 Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjcbwnwwemReTstZhDMJYRD1CsFrHwit4pGibHY9f4w9e-9BuqriA2wwvULWduUQHd1wGJM4kulhzHlNU3aN_xXkfqIyMvPpZMEPxYiynfJXgFKuMcchLZ9a4PrzEHl50Wrfb4edNCxRbm6m2QepCXJ0-y_yHUvBGyakHNUS31woKGE Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:53:33.978546 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b7cdb8d3ddc84d0fbd6128c3b46d05f7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}] Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f3eb282e55c941ef9fefb57e14a708f1 Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 209b2f19-cdd1-4162-b5f5-429775658986 could not be found. Jun 15 19:53:33.980412 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '209b2f19-cdd1-4162-b5f5-429775658986'} Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209b2f19-cdd1-4162-b5f5-429775658986 could not be found. Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:53:33.981563 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209b2f19-cdd1-4162-b5f5-429775658986 could not be found. Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209b2f19-cdd1-4162-b5f5-429775658986 could not be found. Jun 15 19:53:33.983402 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:33.984951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Returning 404 to user: Instance 209b2f19-cdd1-4162-b5f5-429775658986 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:53:33.984951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-3135b346-4c61-4917-b120-264c69299f6f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jun 15 19:53:33.984951 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 514/1037] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:33 2022] GET /compute/v2.1/servers/209b2f19-cdd1-4162-b5f5-429775658986 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:53:37.294963 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:37.295806 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:37.299997 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-46b4e8de-360d-4b20-a91c-82eeb86afb1d req-4c51cd4e-af14-431a-a9ad-4895ad0a0b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b491aa-2d8a-42ac-8399-3636cd440b12", "tag": "4fcb17c7-57eb-4093-bf16-612242dcaec4"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:53:37.302680 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:37.303205 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:37.304071 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:37.304580 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:37.316227 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-46b4e8de-360d-4b20-a91c-82eeb86afb1d req-4c51cd4e-af14-431a-a9ad-4895ad0a0b63 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:37.317009 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-46b4e8de-360d-4b20-a91c-82eeb86afb1d req-4c51cd4e-af14-431a-a9ad-4895ad0a0b63 service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:37.338227 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Going to try to terminate instance {{(pid=129333) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 19:53:37.340305 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-46b4e8de-360d-4b20-a91c-82eeb86afb1d req-4c51cd4e-af14-431a-a9ad-4895ad0a0b63 service nova] Creating event network-changed:4fcb17c7-57eb-4093-bf16-612242dcaec4 for instance a9b491aa-2d8a-42ac-8399-3636cd440b12 on hv-cinder-84456 Jun 15 19:53:37.350967 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-46b4e8de-360d-4b20-a91c-82eeb86afb1d req-4c51cd4e-af14-431a-a9ad-4895ad0a0b63 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056237 Jun 15 19:53:37.353082 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 515/1038] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 19:53:37.430169 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-ba0f6996-166c-4ebd-b735-e684cb33bd62 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 204 len: 0 microversion: 2.1 time: 0.138440 Jun 15 19:53:37.436592 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 524/1039] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:53:37 2022] DELETE /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 19:53:37.450022 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:37.451314 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:37.470417 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:37.471106 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:37.472248 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:37.472867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:37.621773 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.policy [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129334) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:53:37.629555 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-6a3974a7-bf40-4f3f-a12a-5c2e3f8bdc7f tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1579 microversion: 2.1 time: 0.188368 Jun 15 19:53:37.630140 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 516/1040] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:37 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1579 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:53:38.647593 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:38.649129 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:38.656168 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:38.656611 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:38.657384 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:38.657818 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:38.804203 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:53:38.812240 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-1e449920-f68a-4a76-b00b-9b3e4db66e5e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1579 microversion: 2.1 time: 0.168984 Jun 15 19:53:38.812807 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 525/1041] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:38 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 19:53:39.473381 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [req-5d2068ba-f08b-45ac-88fd-116a82fd05a5 req-9e82959b-c41f-47de-a2c0-f2c4913107ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b491aa-2d8a-42ac-8399-3636cd440b12", "name": "network-vif-deleted", "tag": "4fcb17c7-57eb-4093-bf16-612242dcaec4"}]} {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 19:53:39.483428 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-5d2068ba-f08b-45ac-88fd-116a82fd05a5 req-9e82959b-c41f-47de-a2c0-f2c4913107ea service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:39.483867 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [req-5d2068ba-f08b-45ac-88fd-116a82fd05a5 req-9e82959b-c41f-47de-a2c0-f2c4913107ea service nova] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:39.498984 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.compute.server_external_events [req-5d2068ba-f08b-45ac-88fd-116a82fd05a5 req-9e82959b-c41f-47de-a2c0-f2c4913107ea service nova] Creating event network-vif-deleted:4fcb17c7-57eb-4093-bf16-612242dcaec4 for instance a9b491aa-2d8a-42ac-8399-3636cd440b12 on hv-cinder-84456 Jun 15 19:53:39.504819 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [req-5d2068ba-f08b-45ac-88fd-116a82fd05a5 req-9e82959b-c41f-47de-a2c0-f2c4913107ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038716 Jun 15 19:53:39.506285 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 517/1042] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Jun 15 19:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 19:53:39.833373 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:39.834010 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:39.841745 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:39.842266 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:39.843097 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:39.843525 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:39.878881 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:39.879322 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:39.879772 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.objects.instance [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lazy-loading 'fault' on Instance uuid a9b491aa-2d8a-42ac-8399-3636cd440b12 {{(pid=129333) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 19:53:39.930850 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.policy [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3eb282e55c941ef9fefb57e14a708f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7cdb8d3ddc84d0fbd6128c3b46d05f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129333) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 19:53:39.938687 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-34d7cf41-6f06-440d-9339-e27f3b147564 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 200 len: 1231 microversion: 2.1 time: 0.109571 Jun 15 19:53:39.939259 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 526/1043] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:39 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 19:53:40.957421 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:40.958173 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: a9b491aa-2d8a-42ac-8399-3636cd440b12] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:40.964945 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:40.965393 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:40.966178 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:40.966615 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:40.980278 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] HTTP exception thrown: Instance a9b491aa-2d8a-42ac-8399-3636cd440b12 could not be found. Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Request method failure captured: Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 HTTP/1.1 Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjcbwnwwemReTstZhDMJYRD1CsFrHwit4pGibHY9f4w9e-9BuqriA2wwvULWduUQHd1wGJM4kulhzHlNU3aN_xXkfqIyMvPpZMEPxYiynfJXgFKuMcchLZ9a4PrzEHl50Wrfb4edNCxRbm6m2QepCXJ0-y_yHUvBGyakHNUS31woKGE Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:53:40.981891 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b7cdb8d3ddc84d0fbd6128c3b46d05f7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}] Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f3eb282e55c941ef9fefb57e14a708f1 Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance a9b491aa-2d8a-42ac-8399-3636cd440b12 could not be found. Jun 15 19:53:40.984625 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': 'a9b491aa-2d8a-42ac-8399-3636cd440b12'} Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b491aa-2d8a-42ac-8399-3636cd440b12 could not be found. Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:53:40.986206 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b491aa-2d8a-42ac-8399-3636cd440b12 could not be found. Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b491aa-2d8a-42ac-8399-3636cd440b12 could not be found. Jun 15 19:53:40.988903 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:40.991592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Returning 404 to user: Instance a9b491aa-2d8a-42ac-8399-3636cd440b12 could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:53:40.991592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-887867b6-74c1-4053-bdb5-72636e6ca081 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12" status: 404 len: 111 microversion: 2.1 time: 0.030714 Jun 15 19:53:40.991592 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 518/1044] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:40 2022] GET /compute/v2.1/servers/a9b491aa-2d8a-42ac-8399-3636cd440b12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:53:41.433250 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:41.433782 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.compute.api [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129333) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:41.440505 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:41.440965 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:41.441748 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:41.442217 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG oslo_concurrency.lockutils [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:41.455605 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.wsgi [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] HTTP exception thrown: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Request method failure captured: Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: request: DELETE /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c HTTP/1.1 Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept: application/json Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Accept-Encoding: identity Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Connection: close Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Length: 0 Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Content-Type: application/json Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Host: 10.222.0.15 Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Openstack-System-Scope: None Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: User-Agent: python-urllib3/1.26.9 Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Auth-Token: gAAAAABiqjcbwnwwemReTstZhDMJYRD1CsFrHwit4pGibHY9f4w9e-9BuqriA2wwvULWduUQHd1wGJM4kulhzHlNU3aN_xXkfqIyMvPpZMEPxYiynfJXgFKuMcchLZ9a4PrzEHl50Wrfb4edNCxRbm6m2QepCXJ0-y_yHUvBGyakHNUS31woKGE Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Id: None Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Domain-Name: None Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Identity-Status: Confirmed Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Is-Admin-Project: True Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Id: default Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Domain-Name: Default Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Project-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Role: member,reader Jun 15 19:53:41.457275 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Roles: member,reader Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b7cdb8d3ddc84d0fbd6128c3b46d05f7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}] Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-Tenant-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Id: default Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Domain-Name: Default Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Id: f3eb282e55c941ef9fefb57e14a708f1 Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: X-User-Name: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: method: > Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: exception: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.459073 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: action_args: {'id': '72c741e5-dd61-47bd-9d45-7a33d5f0eb6c'} Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:53:41.459978 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.462020 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.464577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Returning 404 to user: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. {{(pid=129333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:53:41.464577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-f3c967ac-a4ed-4449-bc69-b06958a85a7e tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "DELETE /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 404 len: 111 microversion: 2.1 time: 0.030107 Jun 15 19:53:41.464577 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 527/1045] 10.222.0.15 () {58 vars in 1238 bytes} [Wed Jun 15 19:53:41 2022] DELETE /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 19:53:41.468059 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '>' {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:41.468670 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.compute.api [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] [instance: 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c] Fetching instance by UUID {{(pid=129334) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 19:53:41.474782 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:41.475222 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:41.475968 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 19:53:41.476959 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG oslo_concurrency.lockutils [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Lock "c73ff9d0-a9f4-425f-97b1-a5af4dc02ab4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 19:53:41.490613 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.wsgi [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] HTTP exception thrown: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Request method failure captured: Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: request: GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c HTTP/1.1 Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept: application/json Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Accept-Encoding: identity Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Connection: close Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Length: 0 Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Content-Type: application/json Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Host: 10.222.0.15 Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Openstack-System-Scope: None Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: User-Agent: python-urllib3/1.26.9 Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Auth-Token: gAAAAABiqjcbwnwwemReTstZhDMJYRD1CsFrHwit4pGibHY9f4w9e-9BuqriA2wwvULWduUQHd1wGJM4kulhzHlNU3aN_xXkfqIyMvPpZMEPxYiynfJXgFKuMcchLZ9a4PrzEHl50Wrfb4edNCxRbm6m2QepCXJ0-y_yHUvBGyakHNUS31woKGE Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Id: None Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Domain-Name: None Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Identity-Status: Confirmed Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Is-Admin-Project: True Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Id: default Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Domain-Name: Default Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Project-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Role: member,reader Jun 15 19:53:41.492791 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Roles: member,reader Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b7cdb8d3ddc84d0fbd6128c3b46d05f7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b7cdb8d3ddc84d0fbd6128c3b46d05f7"}]}] Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Id: b7cdb8d3ddc84d0fbd6128c3b46d05f7 Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-Tenant-Name: tempest-TestVolumeBootPattern-1157043158 Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Id: default Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Domain-Name: Default Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Id: f3eb282e55c941ef9fefb57e14a708f1 Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: X-User-Name: tempest-TestVolumeBootPattern-1157043158-project Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: method: > Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: exception: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.498826 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: action_args: {'id': '72c741e5-dd61-47bd-9d45-7a33d5f0eb6c'} Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: {{(pid=129334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 19:53:41.499623 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. Jun 15 19:53:41.500933 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: ERROR nova.api.openstack.wsgi Jun 15 19:53:41.502598 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: DEBUG nova.api.openstack.wsgi [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Returning 404 to user: Instance 72c741e5-dd61-47bd-9d45-7a33d5f0eb6c could not be found. {{(pid=129334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 19:53:41.502598 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO nova.api.openstack.requestlog [None req-59e5f669-ff17-4135-86fa-8293c705ad24 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c" status: 404 len: 111 microversion: 2.1 time: 0.030254 Jun 15 19:53:41.502598 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: [pid: 129334|app: 0|req: 519/1046] 10.222.0.15 () {58 vars in 1235 bytes} [Wed Jun 15 19:53:41 2022] GET /compute/v2.1/servers/72c741e5-dd61-47bd-9d45-7a33d5f0eb6c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 19:53:42.798637 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: DEBUG nova.api.openstack.wsgi [None req-8221c9b5-6d06-484f-aed1-d31b4c3f0234 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] Calling method '.version_select at 0x7f16458e40d0>' {{(pid=129333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 19:53:42.830249 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO nova.api.openstack.requestlog [None req-8221c9b5-6d06-484f-aed1-d31b4c3f0234 tempest-TestVolumeBootPattern-1157043158 tempest-TestVolumeBootPattern-1157043158-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1701459937" status: 202 len: 0 microversion: 2.1 time: 0.035989 Jun 15 19:53:42.830652 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: [pid: 129333|app: 0|req: 528/1047] 10.222.0.15 () {58 vars in 1262 bytes} [Wed Jun 15 19:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1701459937 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 19:54:36.999983 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:54:37.000634 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:54:50.058868 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:54:50.059493 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:54:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:56:07.768549 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:56:07.769149 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Wed Jun 15 19:56:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:56:32.012378 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:56:32.013027 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Wed Jun 15 19:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:56:36.150236 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:56:36.151502 dv-cinder-844563-3-iscsi devstack@n-api.service[129333]: Wed Jun 15 19:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:56:47.297679 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:56:47.298352 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:57:57.009790 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:57:57.010572 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:57:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 19:58:10.067168 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 19:58:10.067735 dv-cinder-844563-3-iscsi devstack@n-api.service[129334]: Wed Jun 15 19:58:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!